Jul 10 00:24:05 devstack cinder-volume[75835]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 00:24:05 devstack cinder-volume[75835]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:24:05 devstack cinder-volume[75835]: we strongly recommend against using it for new projects. Jul 10 00:24:05 devstack cinder-volume[75835]: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:24:05 devstack cinder-volume[75835]: framework. For more detail see Jul 10 00:24:05 devstack cinder-volume[75835]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:24:05 devstack cinder-volume[75835]: import eventlet # noqa Jul 10 00:24:08 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:24:08 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:24:08 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:24:09 devstack cinder-volume[75835]: INFO dbcounter [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Registered counter for database cinder Jul 10 00:24:09 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:24:09 devstack cinder-volume[75835]: DEBUG dbcounter [-] [75835] Writer thread running {{(pid=75835) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:24:09 devstack cinder-volume[75835]: INFO cinder.rpc [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 00:24:09 devstack cinder-volume[75835]: INFO cinder.rpc [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 00:24:09 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:24:09 devstack cinder-volume[75835]: INFO cinder.volume.manager [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Determined volume DB was empty at startup. Jul 10 00:24:09 devstack cinder-volume[75835]: DEBUG cinder.volume.manager [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75835) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 00:24:09 devstack cinder-volume[75835]: INFO cinder.volume.manager [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 00:24:09 devstack cinder-volume[75835]: WARNING stevedore.named [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:24:09 devstack cinder-volume[75835]: WARNING castellan.key_manager [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:24:09 devstack cinder-volume[75835]: WARNING cinder.keymgr.conf_key_mgr [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:24:09 devstack cinder-volume[75835]: DEBUG cinder.volume.drivers.lvm [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75835) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 00:24:09 devstack cinder-volume[75835]: DEBUG oslo_concurrency.processutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_concurrency.processutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=75835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:24:10 devstack cinder-volume[75835]: INFO cinder.rpc [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 00:24:10 devstack cinder-volume[75835]: INFO cinder.rpc [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 00:24:10 devstack cinder-volume[75835]: WARNING stevedore.named [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:24:10 devstack cinder-volume[75835]: WARNING castellan.key_manager [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:24:10 devstack cinder-volume[75835]: INFO cinder.volume.manager [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:24:10 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Starting 1 workers Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Started child 76008 {{(pid=75835) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Full set of CONF: {{(pid=75835) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] ******************************************************************************** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Configuration options gathered from: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] ================================================================================ {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] allow_availability_zone_fallback = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] allow_compression_on_image_upload = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] allowed_direct_url_schemes = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] api_rate_limit = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] auth_strategy = keystone {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] az_cache_duration = 3600 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_host = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[76008]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_stats_polling_interval = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backup_api_class = cinder.backup.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backup_name_template = backup-%s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backup_use_same_host = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backup_use_temp_snapshot = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] chap_password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] chap_username = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_internal_tenant_project_id = 1b921b5de720441ab9aaa1d418a65e35 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_internal_tenant_user_id = 9bc1167722b944e3b0252fcc96d01796 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cloned_volume_same_az = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cluster = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] compression_format = gzip {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] config_dir = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] config_source = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] control_exchange = openstack {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] debug = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] default_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] default_group_type = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] default_volume_type = lvmdriver-1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] disk_geometry = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] driver_client_cert = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] driver_client_cert_key = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] driver_data_namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] driver_ssl_cert_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] driver_ssl_cert_verify = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] driver_use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] enable_force_upload = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] enable_new_services = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] enable_unsupported_driver = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack sudo[76012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] enforce_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] filter_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_api_insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_api_servers = ['http://192.168.122.17/image'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_api_ssl_compression = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack sudo[76012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_ca_certificates_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_num_retries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance_request_timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] goodness_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] graceful_shutdown_timeout = 5 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] group_api_class = cinder.group.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] host = devstack {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_compress_on_upload = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_conversion_address_space_limit = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_conversion_cpu_limit = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_conversion_disable = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_upload_use_cinder_backend = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_upload_use_internal_tenant = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_volume_cache_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_volume_cache_max_count = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] init_host_max_objects_retrieval = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] instance_format = [instance: %(uuid)s] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] iscsi_target_flags = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] iscsi_write_cache = on {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] iser_helper = tgtadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] iser_ip_address = 192.168.122.17 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] iser_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_color = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_config_append = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_dir = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_options = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_rotate_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_rotate_interval_type = days {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] log_rotation_type = none {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] max_age = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] max_logfile_count = 30 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] max_logfile_size_mb = 200 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] max_over_subscription_ratio = 20.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] message_reap_interval = 86400 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] message_ttl = 2592000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] monkey_patch = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[76008]: INFO cinder.volume.manager [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] monkey_patch_modules = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] my_ip = 192.168.122.17 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] no_snapshot_gb_quota = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] num_iser_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] num_shell_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] num_volume_device_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] nvmeof_conn_info_version = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] nvmet_ns_id = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] nvmet_port_id = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] osapi_max_limit = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] osapi_volume_ext_list = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] osapi_volume_listen_port = 8776 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] osapi_volume_use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] osapi_volume_workers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] per_volume_size_limit = -1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] periodic_fuzzy_delay = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] periodic_interval = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] public_endpoint = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] publish_errors = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] quota_backup_gigabytes = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] quota_backups = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] quota_gigabytes = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] quota_groups = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] quota_snapshots = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] quota_volumes = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] rate_limit_burst = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] rate_limit_except_level = CRITICAL {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] rate_limit_interval = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] reinit_driver_count = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] replication_device = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] report_discard_supported = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] report_interval = 120 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] reservation_clean_interval = 86400 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] reservation_expire = 86400 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] reserved_image_namespaces = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] reserved_percentage = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] rpc_response_timeout = 120 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] run_external_periodic_tasks = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] scst_target_driver = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] scst_target_iqn_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_down_time = 720 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] shell_completion = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] snapshot_name_template = snapshot-%s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] snapshot_same_host = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] state_path = /opt/stack/data/cinder {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] storage_availability_zone = nova {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] storage_protocol = iSCSI {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] syslog_log_facility = LOG_USER {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] target_helper = lioadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] target_ip_address = 192.168.122.17 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] target_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] target_protocol = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] target_secondary_ip_addresses = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] trace_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] transport_url = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] until_refresh = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] use_chap_auth = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] use_default_quota_class = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] use_journal = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] use_json = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] use_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] use_stderr = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] use_syslog = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] verify_glance_signatures = enabled {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_api_class = cinder.volume.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_backend_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_clear = zero {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_clear_ionice = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_clear_size = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_copy_bps_limit = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_dd_blocksize = 1M {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:10 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_name_template = volume-%s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_service_inithost_offload = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volume_usage_audit_period = month {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] zoning_mode = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.auth_type = password {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.auth_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.cache = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.interface = public {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_password = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcache_username = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.region_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.service_type = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.17/identity {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.backend = dogpile.cache.null {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.backend_argument = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.backend_expiration_time = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.config_prefix = cache.oslo {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.debug_cache_backend = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.enable_retry_client = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.enable_socket_keepalive = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.expiration_time = 600 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.memcache_dead_retry = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.memcache_sasl_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.proxies = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.redis_db = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.redis_server = localhost:6379 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.retry_attempts = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.retry_delay = 0.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.socket_keepalive_count = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.socket_keepalive_idle = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.socket_keepalive_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.socket_timeout = 1.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.tls_allowed_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.tls_cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.tls_certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.tls_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.tls_keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cache.username = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] coordination.backend_url = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.asyncio_connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.asyncio_slave_connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.backend = sqlalchemy {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.connection_debug = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.connection_parameters = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.connection_recycle_time = 3600 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.connection_trace = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.db_inc_retry_interval = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.db_max_retries = 20 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.db_max_retry_interval = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.db_retry_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.max_overflow = 50 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.max_pool_size = 5 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.max_retries = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.pool_timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.retry_interval = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.slave_connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.sqlite_synchronous = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.synchronous_reader = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] database.use_db_reconnect = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.connection_string = messaging:// {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.es_doc_type = notification {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.es_scroll_size = 10000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.es_scroll_time = 2m {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.filter_error_trace = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.hmac_keys = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.sentinel_service_name = mymaster {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.socket_timeout = 0.1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.trace_requests = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler.trace_sqlalchemy = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler_jaeger.process_tags = {} {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] profiler_otlp.service_name_prefix = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.enforce_scope = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.policy_default_rule = default {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] privsep_osbrick.group = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] privsep_osbrick.helper_command = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] privsep_osbrick.user = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_sys_admin.group = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_sys_admin.helper_command = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] cinder_sys_admin.user = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.auth_type = password {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.send_service_user_token = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] service_user.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.auth_type = password {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.region_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] glance.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.backend_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.chap_password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.chap_username = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.disk_geometry = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.driver_client_cert = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.driver_data_namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.driver_use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.extra_capabilities = {} {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.filter_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.goodness_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.iscsi_target_flags = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.iser_ip_address = 192.168.122.17 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.iser_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.lvm_share_target = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.lvm_type = auto {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.replication_device = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.report_discard_supported = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.target_helper = tgtadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.target_ip_address = 192.168.122.17 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.target_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.target_protocol = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.trace_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.use_chap_auth = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_backend_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_clear = zero {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_reports.file_event_handler = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_reports.log_dir = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.backend_host = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.chap_password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.chap_username = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.disk_geometry = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.filter_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.goodness_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.iser_helper = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.iser_port = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.lvm_type = auto {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.replication_device = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.storage_protocol = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.target_ip_address = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.target_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.trace_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_clear = zero {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] lvmdriver-1.volumes_dir = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_notifications.driver = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] key_manager.fixed_key = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.barbican_api_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.barbican_endpoint = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.barbican_endpoint_type = public {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.barbican_region_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.number_of_retries = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.retry_delay = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.send_service_user_token = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.verify_ssl = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican.verify_ssl_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.auth_type = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] barbican_service_user.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.approle_role_id = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.approle_secret_id = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.kv_mountpoint = secret {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.kv_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.kv_version = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.root_token_id = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.ssl_ca_crt_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.timeout = 60.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:24:11 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] ******************************************************************************** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 00:24:11 devstack sudo[76012]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:11 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.825s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:11 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:11 devstack sudo[76302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:11 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:12 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.719s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:24:12 devstack cinder-volume[76008]: INFO cinder.brick.local_dev.lvm [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:12 devstack sudo[76570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:24:12 devstack sudo[76570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:12 devstack sudo[76570]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG cinder.brick.local_dev.lvm [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76008) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 00:24:12 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:12 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:12 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:14 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.127s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:14 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:14 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:14 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:14 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:14 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 00:24:14 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:15 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:15 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.698s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:15 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:15 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:24:15 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:16 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:16 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:16 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:16 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:24:16 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:17 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:17 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.844s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:17 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:17 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:24:17 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:17 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:17 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.761s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:17 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:17 devstack sudo[76816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:17 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:18 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:18 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.902s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:18 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:18 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:18 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:18 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:18 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:19 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:19 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.830s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:19 devstack cinder-volume[76008]: INFO cinder.volume.drivers.lvm [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 00:24:19 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:19 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:19 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:19 devstack sudo[76946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:19 devstack sudo[76946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:20 devstack sudo[76946]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:20 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:20 devstack cinder-volume[76008]: DEBUG cinder.volume.drivers.lvm [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Updating volume stats {{(pid=76008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:24:20 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:20 devstack sudo[77086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:24:20 devstack sudo[77086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:20 devstack cinder-volume[75835]: DEBUG dbcounter [-] [75835] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75835) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:24:20 devstack sudo[77086]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:20 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:20 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:20 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:24:20 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:21 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:21 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:21 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:21 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:21 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:22 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:22 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:22 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:22 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:24:22 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:22 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:22 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:22 devstack cinder-volume[76008]: INFO cinder.volume.driver [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Driver hasn't implemented _init_vendor_properties() Jul 10 00:24:22 devstack cinder-volume[76008]: DEBUG cinder.volume.driver [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76008) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG dbcounter [-] [76008] Writer thread running {{(pid=76008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG cinder.db.api [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Building query based on filter {{(pid=76008) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG cinder.image.image_utils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76008) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 00:24:23 devstack cinder-volume[76008]: INFO cinder.keymgr.migration [None req-0709ddf9-69f2-4570-9b64-0171a3040015 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG cinder.volume.drivers.lvm [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Updating volume stats {{(pid=76008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:23 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:24:23 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:23 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:23 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:23 devstack sudo[77115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:24:23 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:24 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:24 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:24 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:24 devstack sudo[77122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:24 devstack sudo[77122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:25 devstack sudo[77122]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:25 devstack sudo[77126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:24:25 devstack sudo[77126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:25 devstack sudo[77126]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG cinder.manager [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Notifying Schedulers of capabilities ... {{(pid=76008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:24:25 devstack cinder-volume[76008]: INFO cinder.volume.manager [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Driver initialization completed successfully. Jul 10 00:24:25 devstack cinder-volume[76008]: INFO cinder.manager [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Initiating service 2 cleanup Jul 10 00:24:25 devstack cinder-volume[76008]: INFO cinder.manager [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Service 2 cleanup completed. Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG cinder.service [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Creating RPC server for service cinder-volume {{(pid=76008) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG cinder.service [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76008) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 00:24:25 devstack cinder-volume[76008]: INFO cinder.volume.manager [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG cinder.volume.drivers.lvm [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Updating volume stats {{(pid=76008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:24:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:25 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:24:25 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:26 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:26 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:24:26 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:27 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:27 devstack sudo[77190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:24:27 devstack sudo[77190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:27 devstack sudo[77190]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:27 devstack sudo[77196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:24:27 devstack sudo[77196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:28 devstack sudo[77196]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:28 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:28 devstack cinder-volume[76008]: INFO cinder.volume.manager [None req-c1e50b9e-5caa-422a-a31e-af6fb9a79fef None None] Driver post RPC initialization completed successfully. Jul 10 00:24:38 devstack cinder-volume[76008]: DEBUG dbcounter [-] [76008] Writing DB stats cinder:SELECT=4 {{(pid=76008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:24:38 devstack cinder-volume[76008]: DEBUG dbcounter [-] [76008] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:25:24 devstack cinder-volume[76008]: DEBUG oslo_service.periodic_task [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:25:24 devstack cinder-volume[76008]: DEBUG cinder.volume.drivers.lvm [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Updating volume stats {{(pid=76008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:25:24 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:24 devstack sudo[79536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:25:24 devstack sudo[79536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:25 devstack sudo[79536]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:25 devstack sudo[79557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:25:25 devstack sudo[79557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:25 devstack sudo[79557]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:25 devstack sudo[79560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:25:25 devstack sudo[79560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:26 devstack sudo[79560]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:26 devstack sudo[79563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:25:26 devstack sudo[79563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:27 devstack sudo[79563]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:27 devstack cinder-volume[76008]: DEBUG cinder.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Notifying Schedulers of capabilities ... {{(pid=76008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:25:27 devstack cinder-volume[76008]: DEBUG oslo_service.periodic_task [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running periodic task VolumeManager._thread_info {{(pid=76008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:25:27 devstack cinder-volume[76008]: DEBUG cinder.volume.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] thread count: 6 {{(pid=76008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:25:27 devstack cinder-volume[76008]: DEBUG cinder.volume.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] thread info: [<_MainThread(MainThread, started 130338238558336)>, , , , , ] {{(pid=76008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:26:24 devstack cinder-volume[76008]: DEBUG oslo_service.periodic_task [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:26:24 devstack cinder-volume[76008]: DEBUG cinder.volume.drivers.lvm [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Updating volume stats {{(pid=76008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:26:24 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:24 devstack sudo[82827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:26:24 devstack sudo[82827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:25 devstack sudo[82827]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:25 devstack sudo[82845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:26:25 devstack sudo[82845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:25 devstack sudo[82845]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:25 devstack sudo[82848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:26:25 devstack sudo[82848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:26 devstack sudo[82848]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:26 devstack sudo[82856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:26:26 devstack sudo[82856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:27 devstack sudo[82856]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:27 devstack cinder-volume[76008]: DEBUG cinder.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Notifying Schedulers of capabilities ... {{(pid=76008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:38 devstack cinder-volume[76008]: DEBUG dbcounter [-] [76008] Writing DB stats cinder:SELECT=1 {{(pid=76008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:26:38 devstack cinder-volume[76008]: DEBUG dbcounter [-] [76008] Writing DB stats cinder:UPDATE=1 {{(pid=76008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:27:24 devstack cinder-volume[76008]: DEBUG oslo_service.periodic_task [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:27:24 devstack cinder-volume[76008]: DEBUG cinder.volume.drivers.lvm [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Updating volume stats {{(pid=76008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:27:24 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:24 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:27:24 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:25 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:25 devstack sudo[84849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:27:25 devstack sudo[84849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:25 devstack sudo[84849]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:25 devstack sudo[84875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:27:25 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:26 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:26 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:27:26 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:27 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:27 devstack cinder-volume[76008]: DEBUG cinder.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Notifying Schedulers of capabilities ... {{(pid=76008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:27:27 devstack cinder-volume[76008]: DEBUG oslo_service.periodic_task [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running periodic task VolumeManager._thread_info {{(pid=76008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:27:27 devstack cinder-volume[76008]: DEBUG cinder.volume.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] thread count: 6 {{(pid=76008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:27:27 devstack cinder-volume[76008]: DEBUG cinder.volume.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] thread info: [<_MainThread(MainThread, started 130338238558336)>, , , , , ] {{(pid=76008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:28:24 devstack cinder-volume[76008]: DEBUG oslo_service.periodic_task [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:28:24 devstack cinder-volume[76008]: DEBUG cinder.volume.drivers.lvm [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Updating volume stats {{(pid=76008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:28:24 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:24 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:28:24 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:25 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:25 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:28:25 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:25 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:25 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:25 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:28:25 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:26 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:26 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:26 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:28:26 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:27 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:27 devstack cinder-volume[76008]: DEBUG oslo_concurrency.processutils [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76008) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:27 devstack cinder-volume[76008]: DEBUG cinder.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Notifying Schedulers of capabilities ... {{(pid=76008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:28:27 devstack cinder-volume[76008]: DEBUG oslo_service.periodic_task [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] Running periodic task VolumeManager._thread_info {{(pid=76008) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:28:27 devstack cinder-volume[76008]: DEBUG cinder.volume.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] thread count: 6 {{(pid=76008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:28:27 devstack cinder-volume[76008]: DEBUG cinder.volume.manager [None req-5fc3a3c6-f8fe-4020-8fd0-52de4b623fa1 None None] thread info: [<_MainThread(MainThread, started 130338238558336)>, , , , , ] {{(pid=76008) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:28:38 devstack cinder-volume[76008]: DEBUG dbcounter [-] [76008] Writing DB stats cinder:SELECT=1 {{(pid=76008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:28:38 devstack cinder-volume[76008]: DEBUG dbcounter [-] [76008] Writing DB stats cinder:UPDATE=1 {{(pid=76008) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:28:46 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Caught SIGTERM, stopping children Jul 10 00:28:46 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Acquiring lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:28:46 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Acquired lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:28:46 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Releasing lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:28:46 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Stop services. {{(pid=75835) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 00:28:46 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Killing children. {{(pid=75835) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 00:28:46 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Waiting on 1 children to exit Jul 10 00:28:50 devstack cinder-volume[76008]: DEBUG oslo_concurrency.lockutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Acquiring lock "singleton_lock" {{(pid=76008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:28:50 devstack cinder-volume[76008]: DEBUG oslo_concurrency.lockutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Acquired lock "singleton_lock" {{(pid=76008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:28:50 devstack cinder-volume[76008]: DEBUG oslo_concurrency.lockutils [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Releasing lock "singleton_lock" {{(pid=76008) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:28:50 devstack cinder-volume[76008]: WARNING amqp [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 00:28:50 devstack cinder-volume[76008]: WARNING amqp [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 00:28:50 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-0d5c8d89-4697-48f2-83b5-d79d48746ce7 None None] Child 76008 exited with status 0 Jul 10 00:28:51 devstack cinder-volume[86755]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 00:28:51 devstack cinder-volume[86755]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:28:51 devstack cinder-volume[86755]: we strongly recommend against using it for new projects. Jul 10 00:28:51 devstack cinder-volume[86755]: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:28:51 devstack cinder-volume[86755]: framework. For more detail see Jul 10 00:28:51 devstack cinder-volume[86755]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:28:51 devstack cinder-volume[86755]: import eventlet # noqa Jul 10 00:28:53 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:28:53 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:28:53 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:28:54 devstack cinder-volume[86755]: INFO dbcounter [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Registered counter for database cinder Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_db.sqlalchemy.engines [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG dbcounter [-] [86755] Writer thread running {{(pid=86755) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:28:54 devstack cinder-volume[86755]: INFO cinder.rpc [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 00:28:54 devstack cinder-volume[86755]: INFO cinder.rpc [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_db.sqlalchemy.engines [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:28:54 devstack cinder-volume[86755]: INFO cinder.volume.manager [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Determined volume DB was empty at startup. Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG cinder.volume.manager [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86755) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 00:28:54 devstack cinder-volume[86755]: INFO cinder.volume.manager [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 00:28:54 devstack cinder-volume[86755]: WARNING stevedore.named [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:28:54 devstack cinder-volume[86755]: WARNING castellan.key_manager [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:28:54 devstack cinder-volume[86755]: WARNING cinder.keymgr.conf_key_mgr [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:28:54 devstack cinder-volume[86755]: INFO cinder.volume.manager [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_db.sqlalchemy.engines [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:28:54 devstack cinder-volume[86755]: INFO oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Starting 1 workers Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Started child 86972 {{(pid=86755) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Full set of CONF: {{(pid=86755) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] ******************************************************************************** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Configuration options gathered from: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] ================================================================================ {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] allow_availability_zone_fallback = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] allow_compression_on_image_upload = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] allowed_direct_url_schemes = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] api_rate_limit = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] auth_strategy = keystone {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_host = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_stats_polling_interval = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backup_api_class = cinder.backup.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backup_name_template = backup-%s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backup_use_same_host = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86972]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backup_use_temp_snapshot = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] chap_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] chap_username = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_internal_tenant_project_id = 1b921b5de720441ab9aaa1d418a65e35 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_internal_tenant_user_id = 9bc1167722b944e3b0252fcc96d01796 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cluster = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] compression_format = gzip {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] compute_api_class = cinder.compute.nova.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] config_dir = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] config_source = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] control_exchange = openstack {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] debug = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] default_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] default_group_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] default_volume_type = QuobyteHD {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] disk_geometry = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] driver_client_cert = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] driver_client_cert_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] driver_data_namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] driver_ssl_cert_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] driver_ssl_cert_verify = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] driver_use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] enable_new_services = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] enable_unsupported_driver = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] enabled_backends = ['QuobyteHD'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] enforce_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] filter_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_api_insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_api_servers = ['http://192.168.122.17/image'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_api_ssl_compression = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_ca_certificates_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_catalog_info = image:glance:publicURL {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_num_retries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance_request_timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] goodness_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] graceful_shutdown_timeout = 5 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] group_api_class = cinder.group.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] host = devstack {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_compress_on_upload = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_conversion_address_space_limit = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_conversion_cpu_limit = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_conversion_disable = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_upload_use_cinder_backend = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_upload_use_internal_tenant = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_volume_cache_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_volume_cache_max_count = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] image_volume_cache_max_size_gb = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] init_host_max_objects_retrieval = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] instance_format = [instance: %(uuid)s] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] iscsi_target_flags = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] iscsi_write_cache = on {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] iser_helper = tgtadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] iser_ip_address = 192.168.122.17 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] iser_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_color = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_config_append = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_dir = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_options = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_rotate_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_rotate_interval_type = days {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] log_rotation_type = none {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] max_age = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 00:28:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86972) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] max_logfile_count = 30 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] max_logfile_size_mb = 200 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] max_over_subscription_ratio = 20.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] message_reap_interval = 86400 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] message_ttl = 2592000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] migration_create_volume_timeout_secs = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] monkey_patch = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] monkey_patch_modules = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] my_ip = 192.168.122.17 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] no_snapshot_gb_quota = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] num_iser_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] num_shell_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] num_volume_device_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] nvmeof_conn_info_version = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] nvmet_ns_id = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] nvmet_port_id = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] osapi_max_limit = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] osapi_volume_ext_list = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] osapi_volume_listen_port = 8776 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] osapi_volume_use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] osapi_volume_workers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] per_volume_size_limit = -1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] periodic_fuzzy_delay = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] periodic_interval = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] public_endpoint = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] publish_errors = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] quota_backup_gigabytes = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] quota_backups = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] quota_gigabytes = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] quota_groups = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] quota_snapshots = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] quota_volumes = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] rate_limit_burst = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] rate_limit_except_level = CRITICAL {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] rate_limit_interval = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] reinit_driver_count = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] replication_device = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] report_discard_supported = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] report_interval = 120 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] reservation_clean_interval = 86400 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] reservation_expire = 86400 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] reserved_image_namespaces = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] reserved_percentage = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] rpc_response_timeout = 120 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] run_external_periodic_tasks = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] scst_target_driver = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] scst_target_iqn_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_down_time = 720 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] shell_completion = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] snapshot_name_template = snapshot-%s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] state_path = /opt/stack/data/cinder {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] storage_availability_zone = nova {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] storage_protocol = iSCSI {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] syslog_log_facility = LOG_USER {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] target_helper = lioadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] target_ip_address = 192.168.122.17 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] target_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] target_protocol = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] target_secondary_ip_addresses = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] trace_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] transport_url = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] until_refresh = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] use_chap_auth = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] use_default_quota_class = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] use_journal = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] use_json = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] use_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] use_stderr = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] use_syslog = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] verify_glance_signatures = enabled {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_api_class = cinder.volume.api.API {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_backend_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_clear = zero {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_clear_ionice = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_clear_size = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_copy_bps_limit = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_dd_blocksize = 1M {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_name_template = volume-%s {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_service_inithost_offload = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volume_usage_audit_period = month {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] zoning_mode = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_concurrency.disable_process_locking = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.auth_type = password {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.auth_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.cache = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.include_service_catalog = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.interface = public {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_password = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86972) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcache_username = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.region_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.service_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.17/identity {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Running cmd (subprocess): mount.quobyte {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.backend = dogpile.cache.null {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.backend_argument = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.backend_expiration_time = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.config_prefix = cache.oslo {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.debug_cache_backend = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.enable_retry_client = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.enable_socket_keepalive = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.expiration_time = 600 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.hashclient_retry_attempts = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.memcache_dead_retry = 300 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.memcache_pool_maxsize = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.memcache_sasl_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.proxies = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.redis_db = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.redis_server = localhost:6379 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.retry_attempts = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.retry_delay = 0.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.socket_keepalive_count = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.socket_keepalive_idle = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.socket_keepalive_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.socket_timeout = 1.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.tls_allowed_ciphers = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.tls_cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.tls_certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.tls_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.tls_keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cache.username = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] coordination.backend_url = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.asyncio_connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.asyncio_slave_connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.backend = sqlalchemy {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.connection_debug = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.connection_parameters = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.connection_recycle_time = 3600 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.connection_trace = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.db_inc_retry_interval = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.db_max_retries = 20 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.db_max_retry_interval = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.db_retry_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.max_overflow = 50 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.max_pool_size = 5 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.max_retries = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.mysql_wsrep_sync_wait = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.pool_timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.retry_interval = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.slave_connection = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.sqlite_synchronous = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.synchronous_reader = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] database.use_db_reconnect = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.connection_string = messaging:// {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.es_doc_type = notification {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.es_scroll_size = 10000 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.es_scroll_time = 2m {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.filter_error_trace = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.hmac_keys = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.sentinel_service_name = mymaster {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.socket_timeout = 0.1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.trace_requests = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler.trace_sqlalchemy = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler_jaeger.process_tags = {} {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler_jaeger.service_name_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] profiler_otlp.service_name_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.enforce_new_defaults = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.enforce_scope = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.policy_default_rule = default {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.policy_file = policy.yaml {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] privsep_osbrick.group = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] privsep_osbrick.helper_command = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] privsep_osbrick.user = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_sys_admin.group = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_sys_admin.helper_command = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] cinder_sys_admin.user = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.auth_type = password {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.send_service_user_token = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] service_user.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.auth_type = password {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.region_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] glance.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.backend_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.chap_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.chap_username = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.disk_geometry = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.driver_client_cert = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.driver_client_cert_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.driver_data_namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.driver_use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.extra_capabilities = {} {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.filter_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.goodness_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.iscsi_target_flags = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.iscsi_write_cache = on {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.iser_helper = tgtadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.iser_ip_address = 192.168.122.17 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.iser_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_host = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_login = admin {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_mount_options = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_private_key = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_share_path = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:54 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.num_shell_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.quobyte_volume_url = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.replication_device = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.report_discard_supported = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.reserved_percentage = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.target_helper = tgtadm {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.target_ip_address = 192.168.122.17 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.target_port = 3260 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.target_protocol = iscsi {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.trace_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.unique_fqdn_network = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.use_chap_auth = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_backend_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_clear = zero {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_clear_ionice = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_clear_size = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_reports.file_event_handler = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_reports.log_dir = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.backend_availability_zone = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.backend_host = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.chap_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.chap_username = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.chiscsi_conf = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.disk_geometry = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.driver_client_cert = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.driver_data_namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.driver_use_ssl = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.extra_capabilities = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.filter_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.goodness_function = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.iser_helper = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.iser_ip_address = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.iser_port = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.iser_target_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_host = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_login = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_mount_options = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_password = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_private_key = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_share_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_ssh_port = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.num_shell_tries = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.nvmet_port_id = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.replication_device = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.report_discard_supported = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.reserved_percentage = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.scst_target_driver = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.storage_protocol = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.target_helper = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.target_ip_address = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.target_port = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.target_prefix = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.target_protocol = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.trace_flags = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.use_chap_auth = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_clear = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_clear_size = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] QuobyteHD.volumes_dir = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_notifications.driver = [] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_notifications.retry = -1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] key_manager.fixed_key = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.barbican_api_version = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.barbican_endpoint = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack quobyte-client[86977]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 00:28:55 devstack quobyte-client[86977]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.barbican_endpoint_type = public {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.barbican_region_name = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.number_of_retries = 60 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.retry_delay = 1 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.send_service_user_token = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.verify_ssl = True {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican.verify_ssl_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.auth_section = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.auth_type = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.cafile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.certfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.collect_timing = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.insecure = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.keyfile = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.split_loggers = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] barbican_service_user.timeout = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.approle_role_id = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] CMD "mount.quobyte" returned: 1 in 0.133s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.approle_secret_id = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.kv_mountpoint = secret {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.kv_path = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.kv_version = 2 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.namespace = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.root_token_id = **** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.ssl_ca_crt_file = None {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86972]: INFO cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df ... Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.timeout = 60.0 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.use_ssl = False {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 -c /etc/quobyte/client-cinder.cfg {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:28:55 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] ******************************************************************************** {{(pid=86755) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 00:28:55 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 -c /etc/quobyte/client-cinder.cfg Jul 10 00:28:55 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:55 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.805s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:55 devstack cinder-volume[86972]: INFO cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df succeeded Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.821s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:55 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:28:55 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:56 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.873s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:56 devstack cinder-volume[86972]: INFO cinder.volume.driver [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG cinder.volume.driver [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7494049072266, 'free_capacity_gb': 1775.7494049072266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86972) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG oslo_db.sqlalchemy.engines [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writer thread running {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG cinder.db.api [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Building query based on filter {{(pid=86972) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86972) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 00:28:56 devstack cinder-volume[86972]: INFO cinder.keymgr.migration [None req-e861daac-fdfa-4d32-93d5-f002701b5c1a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:56 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:28:56 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:57 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.042s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:57 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:28:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Driver initialization completed successfully. Jul 10 00:28:58 devstack cinder-volume[86972]: INFO cinder.manager [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Initiating service 3 cleanup Jul 10 00:28:58 devstack cinder-volume[86972]: INFO cinder.manager [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Service 3 cleanup completed. Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG cinder.service [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Creating RPC server for service cinder-volume {{(pid=86972) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG cinder.service [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86972) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 00:28:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:58 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:28:58 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:58 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9dfda9aa-8707-4a83-a5d9-16549c602b01 None None] Driver post RPC initialization completed successfully. Jul 10 00:29:00 devstack cinder-volume[86755]: INFO oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Caught SIGTERM, stopping children Jul 10 00:29:00 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Acquiring lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:29:00 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Acquired lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:29:00 devstack cinder-volume[86755]: DEBUG oslo_concurrency.lockutils [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Releasing lock "singleton_lock" {{(pid=86755) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:29:00 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Stop services. {{(pid=86755) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 00:29:00 devstack cinder-volume[86755]: DEBUG oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Killing children. {{(pid=86755) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 00:29:00 devstack cinder-volume[86755]: INFO oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Waiting on 1 children to exit Jul 10 00:29:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Acquiring lock "singleton_lock" {{(pid=86972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:29:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Acquired lock "singleton_lock" {{(pid=86972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:29:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Releasing lock "singleton_lock" {{(pid=86972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:29:02 devstack cinder-volume[86972]: WARNING amqp [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 00:29:02 devstack cinder-volume[86755]: INFO oslo_service.backend._eventlet.service [None req-c56cb4d7-6252-43f3-b6ec-a74657a79d2e None None] Child 86972 exited with status 0 Jul 10 00:29:02 devstack cinder-volume[87363]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 00:29:02 devstack cinder-volume[87363]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:29:02 devstack cinder-volume[87363]: we strongly recommend against using it for new projects. Jul 10 00:29:02 devstack cinder-volume[87363]: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:29:02 devstack cinder-volume[87363]: framework. For more detail see Jul 10 00:29:02 devstack cinder-volume[87363]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:29:02 devstack cinder-volume[87363]: import eventlet # noqa Jul 10 00:29:05 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:29:05 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:29:05 devstack cinder-volume[87363]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:29:05 devstack cinder-volume[87363]: INFO dbcounter [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Registered counter for database cinder Jul 10 00:29:05 devstack cinder-volume[87363]: DEBUG oslo_db.sqlalchemy.engines [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG dbcounter [-] [87363] Writer thread running {{(pid=87363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:29:06 devstack cinder-volume[87363]: INFO cinder.rpc [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 00:29:06 devstack cinder-volume[87363]: INFO cinder.rpc [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_db.sqlalchemy.engines [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:29:06 devstack cinder-volume[87363]: INFO cinder.volume.manager [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Determined volume DB was empty at startup. Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG cinder.volume.manager [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87363) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 00:29:06 devstack cinder-volume[87363]: WARNING stevedore.named [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:29:06 devstack cinder-volume[87363]: WARNING castellan.key_manager [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:29:06 devstack cinder-volume[87363]: WARNING cinder.keymgr.conf_key_mgr [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:29:06 devstack cinder-volume[87363]: INFO cinder.volume.manager [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_db.sqlalchemy.engines [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:29:06 devstack cinder-volume[87363]: INFO oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Starting 1 workers Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Started child 87452 {{(pid=87363) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Full set of CONF: {{(pid=87363) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] ******************************************************************************** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] Configuration options gathered from: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] ================================================================================ {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] allow_availability_zone_fallback = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] allow_compression_on_image_upload = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] allowed_direct_url_schemes = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87452]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] api_rate_limit = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] auth_strategy = keystone {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_host = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_stats_polling_interval = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backup_api_class = cinder.backup.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backup_name_template = backup-%s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backup_use_same_host = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backup_use_temp_snapshot = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] chap_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] chap_username = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_internal_tenant_project_id = 1b921b5de720441ab9aaa1d418a65e35 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_internal_tenant_user_id = 9bc1167722b944e3b0252fcc96d01796 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cluster = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] compression_format = gzip {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] compute_api_class = cinder.compute.nova.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] config_dir = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] config_source = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] control_exchange = openstack {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] debug = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] default_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] default_group_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] default_volume_type = QuobyteHD {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] disk_geometry = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] driver_client_cert = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] driver_client_cert_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] driver_data_namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] driver_ssl_cert_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] driver_ssl_cert_verify = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] driver_use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] enable_new_services = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] enable_unsupported_driver = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] enabled_backends = ['QuobyteHD'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] enforce_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] filter_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_api_insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_api_servers = ['http://192.168.122.17/image'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_api_ssl_compression = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_ca_certificates_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_catalog_info = image:glance:publicURL {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_num_retries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance_request_timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] goodness_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] graceful_shutdown_timeout = 5 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] group_api_class = cinder.group.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] host = devstack {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_compress_on_upload = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_conversion_address_space_limit = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_conversion_cpu_limit = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_conversion_disable = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_upload_use_cinder_backend = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_upload_use_internal_tenant = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_volume_cache_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_volume_cache_max_count = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] image_volume_cache_max_size_gb = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] init_host_max_objects_retrieval = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] instance_format = [instance: %(uuid)s] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] iscsi_target_flags = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] iscsi_write_cache = on {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] iser_helper = tgtadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] iser_ip_address = 192.168.122.17 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] iser_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_color = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_config_append = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_dir = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_options = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_rotate_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_rotate_interval_type = days {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] log_rotation_type = none {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] max_age = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] max_logfile_count = 30 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] max_logfile_size_mb = 200 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] max_over_subscription_ratio = 20.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] message_reap_interval = 86400 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] message_ttl = 2592000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] migration_create_volume_timeout_secs = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] monkey_patch = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] monkey_patch_modules = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] my_ip = 192.168.122.17 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87452) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] no_snapshot_gb_quota = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] num_iser_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] num_shell_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] num_volume_device_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] nvmeof_conn_info_version = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] nvmet_ns_id = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] nvmet_port_id = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] osapi_max_limit = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] osapi_volume_ext_list = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] osapi_volume_listen_port = 8776 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] osapi_volume_use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] osapi_volume_workers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] per_volume_size_limit = -1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] periodic_fuzzy_delay = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] periodic_interval = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] public_endpoint = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] publish_errors = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] quota_backup_gigabytes = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] quota_backups = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] quota_gigabytes = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] quota_groups = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] quota_snapshots = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] quota_volumes = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] rate_limit_burst = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] rate_limit_except_level = CRITICAL {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] rate_limit_interval = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] reinit_driver_count = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] replication_device = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] report_discard_supported = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] report_interval = 120 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] reservation_clean_interval = 86400 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] reservation_expire = 86400 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] reserved_image_namespaces = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] reserved_percentage = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] rpc_response_timeout = 120 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] run_external_periodic_tasks = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] scst_target_driver = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] scst_target_iqn_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_down_time = 720 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] shell_completion = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] snapshot_name_template = snapshot-%s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] state_path = /opt/stack/data/cinder {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] storage_availability_zone = nova {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] storage_protocol = iSCSI {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] syslog_log_facility = LOG_USER {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] target_helper = lioadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] target_ip_address = 192.168.122.17 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] target_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] target_protocol = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] target_secondary_ip_addresses = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] trace_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] transport_url = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] until_refresh = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] use_chap_auth = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] use_default_quota_class = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] use_journal = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] use_json = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] use_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] use_stderr = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] use_syslog = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] verify_glance_signatures = enabled {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_api_class = cinder.volume.api.API {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_backend_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_clear = zero {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_clear_ionice = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_clear_size = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_copy_bps_limit = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_dd_blocksize = 1M {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_name_template = volume-%s {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_service_inithost_offload = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volume_usage_audit_period = month {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] zoning_mode = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_concurrency.disable_process_locking = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.auth_type = password {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.auth_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.cache = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.include_service_catalog = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.interface = public {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_password = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcache_username = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.region_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.service_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.17/identity {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.backend = dogpile.cache.null {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.backend_argument = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.backend_expiration_time = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.config_prefix = cache.oslo {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.debug_cache_backend = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.enable_retry_client = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.enable_socket_keepalive = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.expiration_time = 600 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.hashclient_retry_attempts = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.memcache_dead_retry = 300 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.memcache_pool_maxsize = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.memcache_sasl_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.proxies = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.redis_db = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.redis_server = localhost:6379 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.retry_attempts = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.retry_delay = 0.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.socket_keepalive_count = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.socket_keepalive_idle = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.socket_keepalive_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.socket_timeout = 1.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.tls_allowed_ciphers = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.tls_cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.tls_certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.tls_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.tls_keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cache.username = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] coordination.backend_url = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.asyncio_connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.asyncio_slave_connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.backend = sqlalchemy {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.connection_debug = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.connection_parameters = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.connection_recycle_time = 3600 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.connection_trace = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.db_inc_retry_interval = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.db_max_retries = 20 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.db_max_retry_interval = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87452) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 00:29:06 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 00:29:06 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.db_retry_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.max_overflow = 50 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.max_pool_size = 5 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.max_retries = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.mysql_wsrep_sync_wait = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.pool_timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.retry_interval = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Running cmd (subprocess): mount.quobyte {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.slave_connection = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.sqlite_synchronous = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.synchronous_reader = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] database.use_db_reconnect = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.connection_string = messaging:// {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.es_doc_type = notification {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.es_scroll_size = 10000 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.es_scroll_time = 2m {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.filter_error_trace = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.hmac_keys = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.sentinel_service_name = mymaster {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.socket_timeout = 0.1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.trace_requests = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler.trace_sqlalchemy = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler_jaeger.process_tags = {} {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler_jaeger.service_name_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] profiler_otlp.service_name_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.enforce_new_defaults = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.enforce_scope = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.policy_default_rule = default {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.policy_file = policy.yaml {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] privsep_osbrick.group = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] privsep_osbrick.helper_command = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] privsep_osbrick.user = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_sys_admin.group = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_sys_admin.helper_command = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] cinder_sys_admin.user = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.auth_type = password {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.send_service_user_token = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] service_user.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.auth_type = password {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.region_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] glance.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.backend_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.chap_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.chap_username = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.disk_geometry = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.driver_client_cert = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.driver_client_cert_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.driver_data_namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.driver_use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.extra_capabilities = {} {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.filter_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.goodness_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.iscsi_target_flags = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.iscsi_write_cache = on {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.iser_helper = tgtadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.iser_ip_address = 192.168.122.17 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.iser_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_host = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_login = admin {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_mount_options = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_private_key = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_share_path = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.num_shell_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.quobyte_volume_url = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.replication_device = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.report_discard_supported = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.reserved_percentage = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.target_helper = tgtadm {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.target_ip_address = 192.168.122.17 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.target_port = 3260 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.target_protocol = iscsi {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.trace_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.unique_fqdn_network = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.use_chap_auth = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_backend_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_clear = zero {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_clear_ionice = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_clear_size = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_reports.file_event_handler = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_reports.log_dir = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.backend_availability_zone = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.backend_host = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.chap_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.chap_username = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.chiscsi_conf = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.disk_geometry = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.driver_client_cert = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.driver_data_namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.driver_use_ssl = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.extra_capabilities = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.filter_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.goodness_function = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack quobyte-client[87461]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack quobyte-client[87461]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.iser_helper = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.iser_ip_address = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.iser_port = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.iser_target_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_host = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_login = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_mount_options = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_password = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_private_key = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_share_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_ssh_port = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.num_shell_tries = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.nvmet_port_id = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.replication_device = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.report_discard_supported = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.reserved_percentage = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.scst_target_driver = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.storage_protocol = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.target_helper = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.target_ip_address = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.target_port = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.target_prefix = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.target_protocol = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.trace_flags = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.use_chap_auth = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_clear = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_clear_size = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] QuobyteHD.volumes_dir = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_notifications.driver = [] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_notifications.retry = -1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] key_manager.fixed_key = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.barbican_api_version = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.barbican_endpoint = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.barbican_endpoint_type = public {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.barbican_region_name = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.number_of_retries = 60 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.retry_delay = 1 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.send_service_user_token = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.verify_ssl = True {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican.verify_ssl_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.auth_section = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.auth_type = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.cafile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.certfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.collect_timing = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.insecure = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.keyfile = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.split_loggers = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] barbican_service_user.timeout = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.approle_role_id = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.approle_secret_id = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.kv_mountpoint = secret {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.kv_path = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.kv_version = 2 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.namespace = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.root_token_id = **** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.ssl_ca_crt_file = None {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.timeout = 60.0 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.use_ssl = False {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:29:06 devstack cinder-volume[87363]: DEBUG oslo_service.backend._eventlet.service [None req-70983fcd-93a8-4dc7-b69f-a7e8c65f9fd7 None None] ******************************************************************************** {{(pid=87363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 00:29:07 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.594s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:07 devstack cinder-volume[87452]: INFO cinder.volume.driver [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.volume.driver [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7494354248047, 'free_capacity_gb': 1775.7494354248047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87452) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_db.sqlalchemy.engines [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87452) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writer thread running {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.db.api [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Building query based on filter {{(pid=87452) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87452) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:07 devstack cinder-volume[87452]: INFO cinder.keymgr.migration [None req-94765287-e585-4b1b-abd1-764559b52589 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 00:29:07 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:29:07 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:07 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.612s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:29:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Driver initialization completed successfully. Jul 10 00:29:07 devstack cinder-volume[87452]: INFO cinder.manager [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Initiating service 3 cleanup Jul 10 00:29:07 devstack cinder-volume[87452]: INFO cinder.manager [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Service 3 cleanup completed. Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.service [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Creating RPC server for service cinder-volume {{(pid=87452) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.service [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87452) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 00:29:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:07 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:29:07 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:08 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.607s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-353d747b-6b6c-4689-bb9a-f8a2deb47822 None None] Driver post RPC initialization completed successfully. Jul 10 00:29:16 devstack cinder-volume[87363]: DEBUG dbcounter [-] [87363] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:29:17 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:29:18 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=3 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:29:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:29:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 6 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:29:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Flow 'volume_create_manager' (6df16984-8503-4dbc-a473-3a86a6ab59d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80f3d8b-90e2-4fb9-bb80-7391f6f6f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80f3d8b-90e2-4fb9-bb80-7391f6f6f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1077126385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c3f44c-a98e-4506-9c16-d988bd49f5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25a18fa5a8d4ccda4d90be1d1ef4147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:51Z,use_quota=True,user_id='3ebbda748a984e45b988819809d8896e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b7cde9-a516-4d4d-9da1-53ade9f05109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b7cde9-a516-4d4d-9da1-53ade9f05109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a98e5bf-680e-4aae-937f-a03baf033dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a98e5bf-680e-4aae-937f-a03baf033dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c3f44c-a98e-4506-9c16-d988bd49f5e2', 'volume_name': 'volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615e927e-dd18-4b62-9308-48783438ee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615e927e-dd18-4b62-9308-48783438ee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58889d8f-a399-4e7f-9d94-509a3697e9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:51 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Volume 39c3f44c-a98e-4506-9c16-d988bd49f5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2', 'volume_size': 1} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1077126385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c3f44c-a98e-4506-9c16-d988bd49f5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25a18fa5a8d4ccda4d90be1d1ef4147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:51Z,use_quota=True,user_id='3ebbda748a984e45b988819809d8896e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Creating volume 39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:51 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:30:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:51 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 1073741824 Jul 10 00:30:51 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:52 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 1073741824" returned: 0 in 0.984s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:52 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 Jul 10 00:30:52 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:53 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2" returned: 0 in 0.670s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58889d8f-a399-4e7f-9d94-509a3697e9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71026ad7-288c-4979-976a-bb762f72302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Volume volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 (39c3f44c-a98e-4506-9c16-d988bd49f5e2): created successfully Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71026ad7-288c-4979-976a-bb762f72302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Flow 'volume_create_manager' (6df16984-8503-4dbc-a473-3a86a6ab59d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:53 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-107168d5-1db1-4852-a1c7-6c3f622e0cc9 req-35500c1b-7532-4c17-8501-c03e462de1f7 tempest-VolumesSnapshotsTestJSON-1726209839 None] Created volume successfully. Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:53 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:30:53 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:54 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.735s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 6 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Creating offline snapshot 14c4e986-4290-4e5f-8373-87caf9aae461 of volume 39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:30:54 devstack cinder-volume[87452]: INFO oslo.privsep.daemon [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpteu9jurg/privsep.sock'] Jul 10 00:30:54 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpteu9jurg/privsep.sock Jul 10 00:30:54 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:30:55 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:30:56 devstack cinder-volume[87452]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 00:30:56 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:56 devstack cinder-volume[87452]: INFO oslo.privsep.daemon [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Spawned new privsep daemon via rootwrap Jul 10 00:30:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Accepted privsep connection to /tmp/tmpteu9jurg/privsep.sock {{(pid=87452) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 00:30:56 devstack cinder-volume[87452]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 00:30:56 devstack cinder-volume[87452]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 00:30:56 devstack cinder-volume[87452]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 00:30:56 devstack cinder-volume[87452]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88295 Jul 10 00:30:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cd8c4a-38e3-400e-a893-f0f9a14fdc6e]: (2,) {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5428cf6e-1d06-4a1b-a612-ca9a8eeb1e76]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:56 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 Jul 10 00:30:56 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:57 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2" returned: 0 in 0.965s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:57 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 1G Jul 10 00:30:57 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:58 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 1G" returned: 0 in 0.872s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:58 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 Jul 10 00:30:58 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:59 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461" returned: 0 in 0.852s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:59 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 is being set with open permissions: ugo+rw Jul 10 00:30:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:59 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 Jul 10 00:30:59 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:59 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461" returned: 0 in 0.694s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:59 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.info Jul 10 00:30:59 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:00 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.info" returned: 0 in 1.044s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:00 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.info is being set with open permissions: ugo+rw Jul 10 00:31:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:01 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.info Jul 10 00:31:01 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:01 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.info" returned: 0 in 0.726s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.989s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:01 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-f6b837a4-096b-40cd-80b9-4222fcec60ed req-9db3f993-2bf8-45a6-a968-be609c32007e tempest-VolumesSnapshotsTestJSON-1726209839 None] Create snapshot completed successfully Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "cinder-14c4e986-4290-4e5f-8373-87caf9aae461-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-14c4e986-4290-4e5f-8373-87caf9aae461-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "cinder-quobyte-39c3f44c-a98e-4506-9c16-d988bd49f5e2" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-quobyte-39c3f44c-a98e-4506-9c16-d988bd49f5e2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "cinder-quobyte-14c4e986-4290-4e5f-8373-87caf9aae461" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-quobyte-14c4e986-4290-4e5f-8373-87caf9aae461" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Deleting offline snapshot 14c4e986-4290-4e5f-8373-87caf9aae461 of volume 39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] snapshot_file for this snap is: volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[55834296-0a9c-4bda-8c67-d523427796b0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:02 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 Jul 10 00:31:02 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:03 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461" returned: 0 in 1.093s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f64ef17-d6a2-42d8-b756-7248e3128cbf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:04 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 Jul 10 00:31:04 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:04 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2" returned: 0 in 1.034s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:05 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 Jul 10 00:31:05 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:05 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461" returned: 0 in 0.811s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:05 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461 Jul 10 00:31:05 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:06 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2.14c4e986-4290-4e5f-8373-87caf9aae461" returned: 0 in 0.913s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-quobyte-14c4e986-4290-4e5f-8373-87caf9aae461" released by "_delete_snapshot" :: held 3.995s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-quobyte-39c3f44c-a98e-4506-9c16-d988bd49f5e2" released by "delete_snapshot" :: held 4.033s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:06 devstack cinder-volume[87452]: WARNING cinder.quota [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:06 devstack cinder-volume[87452]: WARNING cinder.quota [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:06 devstack cinder-volume[87452]: DEBUG cinder.quota [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Created reservations ['04f41f5b-21d4-4cf4-94ee-a9e7220c044d', 'db05c064-3028-43d3-bd05-b2e6fdc51c27', 'd24e7162-6b35-49c5-8913-eb49207d3edd', 'f5769af7-e5dd-40b9-b780-f66c3013b69d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Delete snapshot completed successfully. Jul 10 00:31:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-d010704b-8901-4adf-bb9c-172980ebcc44 req-f82b6000-3181-4221-9b22-bf5f2ed012f1 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-14c4e986-4290-4e5f-8373-87caf9aae461-delete_snapshot" released by "delete_snapshot" :: held 4.246s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "cinder-39c3f44c-a98e-4506-9c16-d988bd49f5e2-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-39c3f44c-a98e-4506-9c16-d988bd49f5e2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "cinder-quobyte-39c3f44c-a98e-4506-9c16-d988bd49f5e2" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-quobyte-39c3f44c-a98e-4506-9c16-d988bd49f5e2" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5951cce5-9a76-4614-a3a7-aad61d816b80]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:07 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 Jul 10 00:31:07 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:08 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2" returned: 0 in 0.857s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:08 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2 Jul 10 00:31:08 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:08 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39c3f44c-a98e-4506-9c16-d988bd49f5e2" returned: 0 in 0.792s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-quobyte-39c3f44c-a98e-4506-9c16-d988bd49f5e2" released by "delete_volume" :: held 1.756s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:09 devstack cinder-volume[87452]: WARNING cinder.quota [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG cinder.quota [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Created reservations ['9097b2cc-6f58-4ca3-a4e3-5ec60e5efff8', '6ab9e221-d981-4cee-8d96-be1e3d4ba549', '4685acf7-0e61-4a6f-bcd4-b70d6d5f39fb', '664cc1a0-2502-4045-a096-b22bbc19b792'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:09 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:31:09 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:09 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.766s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:09 devstack cinder-volume[87452]: DEBUG cinder.manager [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Deleted volume successfully. Jul 10 00:31:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-69639540-107f-4026-8442-ed6c5454a125 req-656d4263-e9eb-4759-9c56-a5db579ff421 tempest-VolumesSnapshotsTestJSON-1726209839 None] Lock "cinder-39c3f44c-a98e-4506-9c16-d988bd49f5e2-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c8fe9b41-367a-4ce5-8258-8fcfbc372cce tempest-GroupsV320Test-1841686525 None] Group tempest-GroupsV320Test-Group-760824463: creating Jul 10 00:31:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c8fe9b41-367a-4ce5-8258-8fcfbc372cce tempest-GroupsV320Test-1841686525 None] Group tempest-GroupsV320Test-Group-760824463: created successfully Jul 10 00:31:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c8fe9b41-367a-4ce5-8258-8fcfbc372cce tempest-GroupsV320Test-1841686525 None] Create group completed successfully. Jul 10 00:31:18 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Created reservations ['8f9f384e-4ea7-44a5-8683-8c5c7f130112'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:18 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:31:18 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:19 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.952s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:19 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4d023c70-fcec-4fec-af35-72a78bc0dcc3 tempest-GroupsV320Test-1841686525 None] Delete group completed successfully. Jul 10 00:31:28 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=22,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:31:28 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=2,cinder:SELECT=24 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Flow 'volume_create_manager' (bef837d3-8e9a-4bf2-9e92-72c581ec018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0223749-ff63-49b3-875a-ba37bc66d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0223749-ff63-49b3-875a-ba37bc66d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1712306248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac20313-8a3e-4ce9-ba4e-34d81cd80cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcc104a344942cc9245445738a9c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:34Z,use_quota=True,user_id='f5bc6e989a4a4077b5447b0b8dbc7e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f13f4c-28c0-47aa-9888-92849c3f121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f13f4c-28c0-47aa-9888-92849c3f121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814636ff-5abc-4ff3-8655-87a31c227c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814636ff-5abc-4ff3-8655-87a31c227c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac20313-8a3e-4ce9-ba4e-34d81cd80cf6', 'volume_name': 'volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c1e096-bb9b-41b9-af06-31ad13af3c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c1e096-bb9b-41b9-af06-31ad13af3c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efdaa66-a676-43fa-9695-c2d427783f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6', 'volume_size': 1} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1712306248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac20313-8a3e-4ce9-ba4e-34d81cd80cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcc104a344942cc9245445738a9c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:34Z,use_quota=True,user_id='f5bc6e989a4a4077b5447b0b8dbc7e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Creating volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:34 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:31:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:34 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 1073741824 Jul 10 00:31:34 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:35 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 1073741824" returned: 0 in 1.123s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:35 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 Jul 10 00:31:35 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:36 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" returned: 0 in 0.807s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efdaa66-a676-43fa-9695-c2d427783f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af45658b-52f2-4c25-8072-fc4c68c4d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:36 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Volume volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 (cac20313-8a3e-4ce9-ba4e-34d81cd80cf6): created successfully Jul 10 00:31:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af45658b-52f2-4c25-8072-fc4c68c4d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Flow 'volume_create_manager' (bef837d3-8e9a-4bf2-9e92-72c581ec018b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:36 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-84c7a32a-ca02-4568-ae21-df2c1cb6cd5c tempest-SnapshotsActionsTest-608866669 None] Created volume successfully. Jul 10 00:31:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Creating offline snapshot 4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:31:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8c263f-7159-40fd-b90f-6a35864aa1ff]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:37 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 Jul 10 00:31:37 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:38 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" returned: 0 in 0.903s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:38 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 1G Jul 10 00:31:38 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:39 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 1G" returned: 0 in 0.988s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:39 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:31:39 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:40 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 0.983s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:40 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 is being set with open permissions: ugo+rw Jul 10 00:31:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:40 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:31:40 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:41 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 0.929s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:41 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.info Jul 10 00:31:41 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:42 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.info" returned: 0 in 0.916s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:42 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.info is being set with open permissions: ugo+rw Jul 10 00:31:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:42 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.info Jul 10 00:31:42 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:43 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.info" returned: 0 in 0.860s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.728s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:43 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5638ff94-204a-47a7-81bd-fd9ddd2b13fb tempest-SnapshotsActionsTest-608866669 None] Create snapshot completed successfully Jul 10 00:31:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Creating offline snapshot 43e69e21-be71-4757-872d-88b976f258df of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:31:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede92c7-3ae1-4841-a65a-73b008d9b5d9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:45 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:31:45 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:45 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 0.971s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:45 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df 1G Jul 10 00:31:45 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:47 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df 1G" returned: 0 in 1.191s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:47 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df Jul 10 00:31:47 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:48 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df" returned: 0 in 1.062s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:48 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df is being set with open permissions: ugo+rw Jul 10 00:31:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:48 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df Jul 10 00:31:48 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:48 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df" returned: 0 in 0.856s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.207s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:49 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f1432b3a-8b37-4113-a305-082e21522e15 tempest-SnapshotsActionsTest-608866669 None] Create snapshot completed successfully Jul 10 00:31:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-43e69e21-be71-4757-872d-88b976f258df-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-43e69e21-be71-4757-872d-88b976f258df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-43e69e21-be71-4757-872d-88b976f258df" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-43e69e21-be71-4757-872d-88b976f258df" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Deleting offline snapshot 43e69e21-be71-4757-872d-88b976f258df of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:31:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] snapshot_file for this snap is: volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:31:51 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ea9ac-fbe2-4255-8bd1-6af9a97f8b46]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:51 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df Jul 10 00:31:51 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:52 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df" returned: 0 in 1.604s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e4580-09d7-4432-af32-16c735a02244]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:52 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:31:52 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:31:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:53 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:31:53 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:54 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 1.333s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:54 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df Jul 10 00:31:54 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:55 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.762s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:55 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:55 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:31:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 8 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:31:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:31:55 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df" returned: 0 in 1.812s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:55 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df Jul 10 00:31:55 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:57 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.43e69e21-be71-4757-872d-88b976f258df" returned: 0 in 1.468s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-43e69e21-be71-4757-872d-88b976f258df" released by "_delete_snapshot" :: held 6.427s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" released by "delete_snapshot" :: held 6.507s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:57 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Created reservations ['befa5628-fba8-4d69-8dfc-3d8f48f2cea8', '70398192-107e-4739-b9aa-562cbf813da8', '60d5d2b4-032c-4c11-a509-5e217737ca7c', '45971ece-0806-41d6-abc5-9f2bd1192786'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Delete snapshot completed successfully. Jul 10 00:31:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e6f46fb-6ced-43de-937b-aeaca8e33d27 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-43e69e21-be71-4757-872d-88b976f258df-delete_snapshot" released by "delete_snapshot" :: held 6.868s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Creating offline snapshot ca79f5fc-81a8-4b11-ad79-5c6099ad6163 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:31:59 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd968db0-ba49-4197-9ad5-58f2fe940d1b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:59 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:31:59 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:01 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 1.688s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:01 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 1G Jul 10 00:32:01 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:02 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 1G" returned: 0 in 1.899s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:03 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 Jul 10 00:32:03 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:04 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163" returned: 0 in 1.655s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:04 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 is being set with open permissions: ugo+rw Jul 10 00:32:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:04 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 Jul 10 00:32:04 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:05 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163" returned: 0 in 1.089s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.465s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a7e6d040-ff90-4555-a399-9075603b5411 tempest-SnapshotsActionsTest-608866669 None] Create snapshot completed successfully Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-ca79f5fc-81a8-4b11-ad79-5c6099ad6163-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-ca79f5fc-81a8-4b11-ad79-5c6099ad6163-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-ca79f5fc-81a8-4b11-ad79-5c6099ad6163" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-ca79f5fc-81a8-4b11-ad79-5c6099ad6163" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Deleting offline snapshot ca79f5fc-81a8-4b11-ad79-5c6099ad6163 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] snapshot_file for this snap is: volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee66488-5e68-412d-9934-8b2e8644dfe7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:07 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 Jul 10 00:32:07 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:07 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Flow 'volume_create_manager' (73720ddc-3177-4154-86c6-0b3910acc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f948a00-427d-4391-ab87-226b3dd82bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f948a00-427d-4391-ab87-226b3dd82bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-43189693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da01d423-91db-4e34-84b6-feba3339f631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1233aa3f08084ba7a74897d21587780e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:08Z,use_quota=True,user_id='81d831819e2a463b994218827a6e04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b92e6a7-99d1-452c-94a7-bc00ae238843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b92e6a7-99d1-452c-94a7-bc00ae238843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac7413-320f-40aa-becc-8ef233795f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bac7413-320f-40aa-becc-8ef233795f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da01d423-91db-4e34-84b6-feba3339f631', 'volume_name': 'volume-da01d423-91db-4e34-84b6-feba3339f631', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ace69dd-3634-4a3a-b276-4d66f16c2980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ace69dd-3634-4a3a-b276-4d66f16c2980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf474330-540a-49c5-9909-bd7a6f7e5ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:08 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Volume da01d423-91db-4e34-84b6-feba3339f631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da01d423-91db-4e34-84b6-feba3339f631', 'volume_size': 1} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-43189693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da01d423-91db-4e34-84b6-feba3339f631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1233aa3f08084ba7a74897d21587780e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:08Z,use_quota=True,user_id='81d831819e2a463b994218827a6e04d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Creating volume da01d423-91db-4e34-84b6-feba3339f631 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:08 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:08 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 1073741824 Jul 10 00:32:08 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:08 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163" returned: 0 in 1.073s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbc9d19-81fc-4321-bdf1-bb8fe77a3063]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:08 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:08 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:09 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 1.265s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:09 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 Jul 10 00:32:09 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:09 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 1073741824" returned: 0 in 1.563s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:09 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 Jul 10 00:32:09 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:11 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163" returned: 0 in 1.406s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:11 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163 Jul 10 00:32:11 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:12 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631" returned: 0 in 2.211s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] <== create_volume: return (3884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.889s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf474330-540a-49c5-9909-bd7a6f7e5ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da01d423-91db-4e34-84b6-feba3339f631', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a6b2c9-4f54-4238-9556-1226309b2d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Volume volume-da01d423-91db-4e34-84b6-feba3339f631 (da01d423-91db-4e34-84b6-feba3339f631): created successfully Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a6b2c9-4f54-4238-9556-1226309b2d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Flow 'volume_create_manager' (73720ddc-3177-4154-86c6-0b3910acc90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3bd7c7b5-2526-4cc7-99bf-65c08f55e14b tempest-VolumesAdminNegativeTest-1181160456 None] Created volume successfully. Jul 10 00:32:12 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.ca79f5fc-81a8-4b11-ad79-5c6099ad6163" returned: 0 in 1.763s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-ca79f5fc-81a8-4b11-ad79-5c6099ad6163" released by "_delete_snapshot" :: held 5.704s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" released by "delete_snapshot" :: held 5.761s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Acquiring lock "cinder-da01d423-91db-4e34-84b6-feba3339f631-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Created reservations ['7b107b44-c86f-4c5d-a5bf-0500b2d59cfc', 'ecdb1b88-3468-4e15-86cf-bbab22a70131', '97319112-2d3a-4e13-9ff7-0cc182f6559b', 'e0182161-c813-49e6-b01e-445c1a1f10eb'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Lock "cinder-da01d423-91db-4e34-84b6-feba3339f631-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Acquiring lock "cinder-quobyte-da01d423-91db-4e34-84b6-feba3339f631" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Delete snapshot completed successfully. Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Lock "cinder-quobyte-da01d423-91db-4e34-84b6-feba3339f631" acquired by "delete_volume" :: waited 0.044s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e97ff81f-db2a-4add-ac52-348295d25008 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-ca79f5fc-81a8-4b11-ad79-5c6099ad6163-delete_snapshot" released by "delete_snapshot" :: held 6.519s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d35078-5c24-4b73-99c7-89c5d8e71650]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:14 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 Jul 10 00:32:14 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Creating offline snapshot d2c5327e-2c4b-47ee-9adb-fecfedef4168 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:32:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b2aea-3d52-4c03-a8c9-2d9d47b77317]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:15 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631" returned: 0 in 1.674s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:15 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631 Jul 10 00:32:15 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:15 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:15 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:17 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 2.142s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:17 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 1G Jul 10 00:32:17 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:17 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-da01d423-91db-4e34-84b6-feba3339f631" returned: 0 in 2.149s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Lock "cinder-quobyte-da01d423-91db-4e34-84b6-feba3339f631" released by "delete_volume" :: held 3.950s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Created reservations ['a382a08e-2ae1-46b5-b8ff-3fec197f3745', '301f14bb-e96f-4fb0-a7f3-5633f97b4044', '80315320-1dde-45dc-94c5-922c14457f70', '4f1e182f-15c2-4c25-bc56-d8aa10079f06'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:18 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:32:18 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:19 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.192s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:19 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Deleted volume successfully. Jul 10 00:32:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fce85e01-613a-4f98-a80a-7b6accd8ed9d tempest-VolumesAdminNegativeTest-1181160456 None] Lock "cinder-da01d423-91db-4e34-84b6-feba3339f631-delete_volume" released by "delete_volume" :: held 5.953s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:19 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 1G" returned: 0 in 1.929s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:19 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 Jul 10 00:32:19 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:20 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168" returned: 0 in 1.108s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:20 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 is being set with open permissions: ugo+rw Jul 10 00:32:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:20 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 Jul 10 00:32:20 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:21 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168" returned: 0 in 1.218s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.687s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1203d6bd-2a05-460c-9a64-40fc94ef30a9 tempest-SnapshotsActionsTest-608866669 None] Create snapshot completed successfully Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-d2c5327e-2c4b-47ee-9adb-fecfedef4168-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-d2c5327e-2c4b-47ee-9adb-fecfedef4168-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-d2c5327e-2c4b-47ee-9adb-fecfedef4168" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-d2c5327e-2c4b-47ee-9adb-fecfedef4168" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Deleting offline snapshot d2c5327e-2c4b-47ee-9adb-fecfedef4168 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] snapshot_file for this snap is: volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b3bc7-8151-49f7-bf76-eb4b147634a6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:23 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 Jul 10 00:32:23 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:24 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168" returned: 0 in 1.115s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5915b7-4661-4c2d-b0c6-b06a7460beba]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:24 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:24 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:25 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 0.959s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:25 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 Jul 10 00:32:25 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:26 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168" returned: 0 in 1.025s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:26 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168 Jul 10 00:32:26 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:26 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.d2c5327e-2c4b-47ee-9adb-fecfedef4168" returned: 0 in 0.829s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-d2c5327e-2c4b-47ee-9adb-fecfedef4168" released by "_delete_snapshot" :: held 4.059s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" released by "delete_snapshot" :: held 4.090s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:27 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Created reservations ['c7ba4b55-9018-4756-bece-ad69cda3ddfb', '5fc780f2-ecf8-443a-9a74-0e3a35d766d1', 'befa7919-dff8-482f-8c56-1c5019982fbe', '2e4eeb1f-0cb0-4959-b687-9bda7334481e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Delete snapshot completed successfully. Jul 10 00:32:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9fa6d36a-66d6-44c0-b2a7-4c1dd520abd5 tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-d2c5327e-2c4b-47ee-9adb-fecfedef4168-delete_snapshot" released by "delete_snapshot" :: held 4.310s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:28 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=29,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:32:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Creating offline snapshot 1f93ee35-a300-4c84-bfc3-990ec3fce192 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:32:28 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[885f1866-07ba-439a-a03a-5f4bc1b8b290]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:28 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:28 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=40,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Flow 'volume_create_manager' (8f16fd61-b4bc-4b64-9a7d-6f61bbe21952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b97353-9b24-4c0e-ae52-51b2ca465d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b97353-9b24-4c0e-ae52-51b2ca465d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-199114002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8002f8-baad-44e4-88dd-5237abfbb4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac3c95e7854cd3b5c5ef508cd348e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:29Z,use_quota=True,user_id='ffa42cce99a24e9bb23be828dd304b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c45810-3500-4938-bc56-5e056672e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c45810-3500-4938-bc56-5e056672e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493f297f-ed57-425c-ab52-62b7b69cc041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493f297f-ed57-425c-ab52-62b7b69cc041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8002f8-baad-44e4-88dd-5237abfbb4da', 'volume_name': 'volume-ff8002f8-baad-44e4-88dd-5237abfbb4da', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fc6984-610b-417b-babf-4e873eeda3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fc6984-610b-417b-babf-4e873eeda3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b769068-f1ed-418a-a8af-7c9a45b4c79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Volume ff8002f8-baad-44e4-88dd-5237abfbb4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8002f8-baad-44e4-88dd-5237abfbb4da', 'volume_size': 1} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:29 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 0.858s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:29 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 1G Jul 10 00:32:29 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:30 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 1G" returned: 0 in 1.173s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:30 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 Jul 10 00:32:30 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:31 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192" returned: 0 in 0.811s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:31 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 is being set with open permissions: ugo+rw Jul 10 00:32:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:31 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 Jul 10 00:32:31 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:32 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192" returned: 0 in 0.751s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.732s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-199114002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8002f8-baad-44e4-88dd-5237abfbb4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac3c95e7854cd3b5c5ef508cd348e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:29Z,use_quota=True,user_id='ffa42cce99a24e9bb23be828dd304b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Creating volume ff8002f8-baad-44e4-88dd-5237abfbb4da {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:32 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:32 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da 1073741824 Jul 10 00:32:32 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-eb7bd508-18be-4a95-9c2d-59aefb7ef239 tempest-SnapshotsActionsTest-608866669 None] Create snapshot completed successfully Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-1f93ee35-a300-4c84-bfc3-990ec3fce192-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-1f93ee35-a300-4c84-bfc3-990ec3fce192-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Acquiring lock "cinder-quobyte-1f93ee35-a300-4c84-bfc3-990ec3fce192" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-1f93ee35-a300-4c84-bfc3-990ec3fce192" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Deleting offline snapshot 1f93ee35-a300-4c84-bfc3-990ec3fce192 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] snapshot_file for this snap is: volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b645a5-bc47-43a9-9a7b-5e437f89f2b5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:33 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 Jul 10 00:32:33 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:33 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da 1073741824" returned: 0 in 0.954s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:33 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da Jul 10 00:32:33 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:33 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192" returned: 0 in 0.979s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:33 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[55969d34-35a1-451e-b4c7-beaea7f589b5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:34 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da" returned: 0 in 0.782s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b769068-f1ed-418a-a8af-7c9a45b4c79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8002f8-baad-44e4-88dd-5237abfbb4da', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0799963b-a229-4248-9c8b-6faa51f5cc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:34 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Volume volume-ff8002f8-baad-44e4-88dd-5237abfbb4da (ff8002f8-baad-44e4-88dd-5237abfbb4da): created successfully Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0799963b-a229-4248-9c8b-6faa51f5cc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:34 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:34 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Flow 'volume_create_manager' (8f16fd61-b4bc-4b64-9a7d-6f61bbe21952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-87171b88-14f1-403d-a0bb-5bcb28740624 tempest-ServersNegativeTestJSON-1830427958 None] Created volume successfully. Jul 10 00:32:34 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 0.856s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:34 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 Jul 10 00:32:34 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:36 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192" returned: 0 in 1.173s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:36 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192 Jul 10 00:32:36 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:36 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.1f93ee35-a300-4c84-bfc3-990ec3fce192" returned: 0 in 0.890s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-1f93ee35-a300-4c84-bfc3-990ec3fce192" released by "_delete_snapshot" :: held 4.022s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" released by "delete_snapshot" :: held 4.054s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:36 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Flow 'volume_create_manager' (941f1dc6-c33b-4293-809b-da251ec6dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607ae22b-d510-4cc3-8b44-9071d05d41a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607ae22b-d510-4cc3-8b44-9071d05d41a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-336324680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153aed17-9cbc-482d-9d7e-ce1f685941cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac3c95e7854cd3b5c5ef508cd348e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:37Z,use_quota=True,user_id='ffa42cce99a24e9bb23be828dd304b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79965b45-d927-4081-9eea-7aa417e3a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79965b45-d927-4081-9eea-7aa417e3a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542a014f-94e7-4983-b226-a8dede2cf8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542a014f-94e7-4983-b226-a8dede2cf8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153aed17-9cbc-482d-9d7e-ce1f685941cd', 'volume_name': 'volume-153aed17-9cbc-482d-9d7e-ce1f685941cd', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa87de8-17c7-4431-bdea-dad9773cf3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa87de8-17c7-4431-bdea-dad9773cf3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9268ef2-934a-4ee9-9049-2a046f54b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Volume 153aed17-9cbc-482d-9d7e-ce1f685941cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153aed17-9cbc-482d-9d7e-ce1f685941cd', 'volume_size': 1} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-336324680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153aed17-9cbc-482d-9d7e-ce1f685941cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ac3c95e7854cd3b5c5ef508cd348e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:37Z,use_quota=True,user_id='ffa42cce99a24e9bb23be828dd304b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Creating volume 153aed17-9cbc-482d-9d7e-ce1f685941cd {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:37 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:37 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd 1073741824 Jul 10 00:32:37 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Created reservations ['8c56613c-624e-4ca5-8dfb-cf0b3920f0e2', '85043a64-f2b0-4c4a-9197-f70641c9a64a', 'f389cf01-38b1-4a5f-81fa-654d9f6cfa1d', '829d98fe-9c77-4374-86c4-b312c87e0e04'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Delete snapshot completed successfully. Jul 10 00:32:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c127f74a-aa53-400d-8346-43325b31c06f tempest-SnapshotsActionsTest-1634946423 None] Lock "cinder-1f93ee35-a300-4c84-bfc3-990ec3fce192-delete_snapshot" released by "delete_snapshot" :: held 4.381s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:38 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd 1073741824" returned: 0 in 1.219s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:38 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd Jul 10 00:32:38 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "cinder-4c97b2d7-006c-4b67-ab6e-07d79e40ecb5-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-4c97b2d7-006c-4b67-ab6e-07d79e40ecb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.112s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "cinder-quobyte-4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-quobyte-4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Deleting offline snapshot 4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 of volume cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:32:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] snapshot_file for this snap is: volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff547cd-0b1b-4e1d-8f77-9f8e28792561]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:39 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:39 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:39 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd" returned: 0 in 1.011s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9268ef2-934a-4ee9-9049-2a046f54b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153aed17-9cbc-482d-9d7e-ce1f685941cd', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432655a8-4516-4917-afb3-59208d9bacc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:39 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Volume volume-153aed17-9cbc-482d-9d7e-ce1f685941cd (153aed17-9cbc-482d-9d7e-ce1f685941cd): created successfully Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432655a8-4516-4917-afb3-59208d9bacc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Flow 'volume_create_manager' (941f1dc6-c33b-4293-809b-da251ec6dd54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:39 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-86a0cd73-9cf7-4b01-8dfb-dffd80a3f6f7 tempest-ServersNegativeTestJSON-1830427958 None] Created volume successfully. Jul 10 00:32:40 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 1.389s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d705b3-cf10-44cb-9ec1-2d42d78b129c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:40 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 Jul 10 00:32:40 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "cinder-153aed17-9cbc-482d-9d7e-ce1f685941cd-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-153aed17-9cbc-482d-9d7e-ce1f685941cd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "cinder-quobyte-153aed17-9cbc-482d-9d7e-ce1f685941cd" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-quobyte-153aed17-9cbc-482d-9d7e-ce1f685941cd" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[25429712-1384-4698-8bde-d9808358b6f0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:41 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd Jul 10 00:32:41 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:41 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" returned: 0 in 1.398s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:41 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:41 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:42 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd" returned: 0 in 1.405s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:42 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd Jul 10 00:32:42 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Flow 'volume_create_manager' (8ecc92b6-1fb8-4f92-b0ac-3a8e6122f75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb7cf2d-bb50-4c51-bcaa-99394edc18fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb7cf2d-bb50-4c51-bcaa-99394edc18fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1068335338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ef441d-b8ef-4c02-8454-c01676ac02d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae4681e47b944f2b75c98a4ed742931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:42Z,use_quota=True,user_id='e8d6fc52bfb4471fb7a9685fe94bd2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91c753d-e1c2-4436-ac7a-f457f87e987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91c753d-e1c2-4436-ac7a-f457f87e987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0754b5e-68e3-46b1-ae41-c7b093771f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0754b5e-68e3-46b1-ae41-c7b093771f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ef441d-b8ef-4c02-8454-c01676ac02d3', 'volume_name': 'volume-52ef441d-b8ef-4c02-8454-c01676ac02d3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7080dfab-5444-48d9-95b8-89388faa4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7080dfab-5444-48d9-95b8-89388faa4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06eee6e5-89d9-4693-ac65-bed713376838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:42 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Volume 52ef441d-b8ef-4c02-8454-c01676ac02d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ef441d-b8ef-4c02-8454-c01676ac02d3', 'volume_size': 1} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1068335338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ef441d-b8ef-4c02-8454-c01676ac02d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae4681e47b944f2b75c98a4ed742931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:42Z,use_quota=True,user_id='e8d6fc52bfb4471fb7a9685fe94bd2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Creating volume 52ef441d-b8ef-4c02-8454-c01676ac02d3 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:42 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:32:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:42 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 1073741824 Jul 10 00:32:42 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:43 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 1.208s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:43 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5 Jul 10 00:32:43 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:43 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-153aed17-9cbc-482d-9d7e-ce1f685941cd" returned: 0 in 0.921s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-quobyte-153aed17-9cbc-482d-9d7e-ce1f685941cd" released by "delete_volume" :: held 2.429s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Created reservations ['11520ad7-2cac-4d74-9ed2-7e0a7b67948c', '2be13c5f-d41a-4b5f-8b42-0e351a67c03f', '35bc6a82-bfa7-4bd5-8b09-145ed0d253bd', 'b1445fa4-303e-43e5-8991-9fee2e4620bd'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:43 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:32:43 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:43 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 1073741824" returned: 0 in 1.405s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:44 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 Jul 10 00:32:44 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "cinder-ff8002f8-baad-44e4-88dd-5237abfbb4da-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-ff8002f8-baad-44e4-88dd-5237abfbb4da-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "cinder-quobyte-ff8002f8-baad-44e4-88dd-5237abfbb4da" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-quobyte-ff8002f8-baad-44e4-88dd-5237abfbb4da" acquired by "delete_volume" :: waited 0.044s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:44 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6.4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" returned: 0 in 1.470s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eefdd0-c796-4576-9086-3fc3eeacee67]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-quobyte-4c97b2d7-006c-4b67-ab6e-07d79e40ecb5" released by "_delete_snapshot" :: held 5.677s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" released by "delete_snapshot" :: held 5.713s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:44 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.162s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Deleted volume successfully. Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1836fc78-4c16-41be-bc2e-26e9442b2ad1 tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-153aed17-9cbc-482d-9d7e-ce1f685941cd-delete_volume" released by "delete_volume" :: held 4.068s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:44 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da Jul 10 00:32:44 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Created reservations ['a68e3d20-4e22-40ca-ab91-cb87032f5cd0', '09a7f746-b44b-481e-a932-f2cdbdcb6f20', 'c90b7434-f272-48e0-9429-2fe313591b2d', '2e9b7fc1-1703-474c-9709-632a67368198'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Delete snapshot completed successfully. Jul 10 00:32:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-108af342-560c-4e3e-8cfa-bf50045b5e3b tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-4c97b2d7-006c-4b67-ab6e-07d79e40ecb5-delete_snapshot" released by "delete_snapshot" :: held 6.027s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:45 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3" returned: 0 in 1.233s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] <== create_volume: return (2762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.766s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06eee6e5-89d9-4693-ac65-bed713376838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ef441d-b8ef-4c02-8454-c01676ac02d3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a37008-e38f-4ec2-9309-8a6394cf2cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Volume volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 (52ef441d-b8ef-4c02-8454-c01676ac02d3): created successfully Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a37008-e38f-4ec2-9309-8a6394cf2cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Flow 'volume_create_manager' (8ecc92b6-1fb8-4f92-b0ac-3a8e6122f75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a1ba4bd5-7e88-4a9d-93c2-34f7982819bc tempest-DeleteServersTestJSON-1180375202 None] Created volume successfully. Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "cinder-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" acquired by "delete_volume" :: waited 0.043s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6e07d-32ec-42e5-b7bb-0eb0b4f16420]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:45 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da" returned: 0 in 1.305s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:45 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da Jul 10 00:32:45 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:45 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 Jul 10 00:32:45 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:46 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" returned: 0 in 1.098s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:46 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6 Jul 10 00:32:46 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:46 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-ff8002f8-baad-44e4-88dd-5237abfbb4da" returned: 0 in 1.022s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-quobyte-ff8002f8-baad-44e4-88dd-5237abfbb4da" released by "delete_volume" :: held 2.408s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:46 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Created reservations ['8c086b9a-3911-4e38-89ef-82774b2fe636', '71a856b5-658c-44bb-8531-d3563cd10d43', 'e58524a3-66aa-4387-9ce5-29aa38e49941', '333f6e3b-3ed8-4090-93a7-6abac570b6f8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:47 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:32:47 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:47 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" returned: 0 in 1.017s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-quobyte-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6" released by "delete_volume" :: held 2.236s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:47 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.832s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Deleted volume successfully. Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-312062ca-5099-4e6e-8323-79579b376b0c tempest-ServersNegativeTestJSON-1830427958 None] Lock "cinder-ff8002f8-baad-44e4-88dd-5237abfbb4da-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:47 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Created reservations ['78db167f-10cf-4062-9134-949ab4168324', '6dd6c320-b3e3-44df-bf4c-2409e001979e', '11f693cc-3e84-4a2c-b263-3aba81ecdd53', 'b82bca0b-e39e-43b3-a4cc-fb588935865d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:48 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:32:48 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:49 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.196s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:49 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:49 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Deleted volume successfully. Jul 10 00:32:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b297c8c-53f4-4a3e-8ad2-49453b159e44 tempest-SnapshotsActionsTest-608866669 None] Lock "cinder-cac20313-8a3e-4ce9-ba4e-34d81cd80cf6-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:52 devstack cinder-volume[87452]: WARNING py.warnings [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 10 00:32:52 devstack cinder-volume[87452]: .first() Jul 10 00:32:52 devstack cinder-volume[87452]: Jul 10 00:32:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad9245d-9b4d-4e0a-8e5a-9a42599b631c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:52 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 Jul 10 00:32:52 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:53 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:53 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:32:53 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3" returned: 0 in 0.887s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-52ef441d-b8ef-4c02-8454-c01676ac02d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47cb18ea-335e-4a7e-b1e7-55322a485c2b', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:32:53 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-badf2980-5adb-4501-bd34-4165cfd8ac63 req-119beb0f-999f-44f7-98c3-c2d061950924 tempest-DeleteServersTestJSON-1180375202 None] attachment_update completed successfully. Jul 10 00:32:54 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.799s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Flow 'volume_create_manager' (91416285-e38d-448c-97ed-07002d0dc17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15c1f40-bfc3-4f58-baec-8a336c8f4fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15c1f40-bfc3-4f58-baec-8a336c8f4fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2023709817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7957abe3-b6a5-4e6c-a0bc-44fc2107301e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdbbb96f6d849b1953cf26e46d4616f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:58Z,use_quota=True,user_id='e9394d43ed13400d85e985e4520d32d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4088700a-8be6-4cf7-a546-e77b8a495437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4088700a-8be6-4cf7-a546-e77b8a495437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccea104-bc83-4018-b288-45efdd4902ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccea104-bc83-4018-b288-45efdd4902ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7957abe3-b6a5-4e6c-a0bc-44fc2107301e', 'volume_name': 'volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7e6407-6c27-4e13-abe3-4c416acc2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7e6407-6c27-4e13-abe3-4c416acc2238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a6c411-27d1-42c1-930f-bbc52dfe808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Volume 7957abe3-b6a5-4e6c-a0bc-44fc2107301e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e', 'volume_size': 1} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2023709817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7957abe3-b6a5-4e6c-a0bc-44fc2107301e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdbbb96f6d849b1953cf26e46d4616f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:58Z,use_quota=True,user_id='e9394d43ed13400d85e985e4520d32d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Creating volume 7957abe3-b6a5-4e6c-a0bc-44fc2107301e {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:58 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:32:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:58 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e 1073741824 Jul 10 00:32:58 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:59 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e 1073741824" returned: 0 in 1.255s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:59 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e Jul 10 00:32:59 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:00 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e" returned: 0 in 0.708s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a6c411-27d1-42c1-930f-bbc52dfe808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7604b24a-09b6-42ea-9305-afa1789ea3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Volume volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e (7957abe3-b6a5-4e6c-a0bc-44fc2107301e): created successfully Jul 10 00:33:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7604b24a-09b6-42ea-9305-afa1789ea3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Flow 'volume_create_manager' (91416285-e38d-448c-97ed-07002d0dc17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c7db3885-724c-4bc4-9a02-7e22850bcd24 tempest-VolumeQuotasAdminTestJSON-274698301 None] Created volume successfully. Jul 10 00:33:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Acquiring lock "cinder-7957abe3-b6a5-4e6c-a0bc-44fc2107301e-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "cinder-7957abe3-b6a5-4e6c-a0bc-44fc2107301e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Acquiring lock "cinder-quobyte-7957abe3-b6a5-4e6c-a0bc-44fc2107301e" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "cinder-quobyte-7957abe3-b6a5-4e6c-a0bc-44fc2107301e" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1727bc89-d3bd-4618-8d39-c236a4cd3496]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:01 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e Jul 10 00:33:01 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:02 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e" returned: 0 in 1.061s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:02 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e Jul 10 00:33:02 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:03 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7957abe3-b6a5-4e6c-a0bc-44fc2107301e" returned: 0 in 1.024s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "cinder-quobyte-7957abe3-b6a5-4e6c-a0bc-44fc2107301e" released by "delete_volume" :: held 2.162s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Created reservations ['13d8e684-42cb-4ae7-8747-6fcdf732a77a', 'd0d9d2c7-f036-47db-a99c-60029f9cf47f', '26480207-028c-467d-b9a3-6fed47552e2b', '2060a365-950d-47bc-9085-1238ba0d6ae7'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:04 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:33:04 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-997c4d1d-7e42-4c59-84f4-aef785fa1c50 req-c57bf07a-1949-492b-b376-95fc2e22c057 tempest-DeleteServersTestJSON-1180375202 None] Terminate volume connection completed successfully. Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-997c4d1d-7e42-4c59-84f4-aef785fa1c50 req-c57bf07a-1949-492b-b376-95fc2e22c057 tempest-DeleteServersTestJSON-1180375202 None] Deleting attachment 47cb18ea-335e-4a7e-b1e7-55322a485c2b. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:33:04 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.753s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Deleted volume successfully. Jul 10 00:33:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2ffe18ec-b755-444b-8178-dc11a0263acf tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "cinder-7957abe3-b6a5-4e6c-a0bc-44fc2107301e-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Flow 'volume_create_manager' (b273d254-3fe4-49a0-a0c0-9d4ff656e95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b86b7cf-add7-4e86-ae42-85da57a6dda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b86b7cf-add7-4e86-ae42-85da57a6dda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1739993743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb39d20-581d-47d2-b2a4-22533a19deae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdbbb96f6d849b1953cf26e46d4616f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:06Z,use_quota=True,user_id='e9394d43ed13400d85e985e4520d32d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca2901f-cf6d-4354-a1eb-1ed40d1aa874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca2901f-cf6d-4354-a1eb-1ed40d1aa874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9361bac0-31d6-47f6-9e15-faf284965e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9361bac0-31d6-47f6-9e15-faf284965e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb39d20-581d-47d2-b2a4-22533a19deae', 'volume_name': 'volume-6fb39d20-581d-47d2-b2a4-22533a19deae', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ea6d86-d67c-4a1b-99bb-6322685fd3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ea6d86-d67c-4a1b-99bb-6322685fd3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74eec758-0f36-4263-a5ff-1932c156c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:05 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Volume 6fb39d20-581d-47d2-b2a4-22533a19deae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb39d20-581d-47d2-b2a4-22533a19deae', 'volume_size': 1} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1739993743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb39d20-581d-47d2-b2a4-22533a19deae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdbbb96f6d849b1953cf26e46d4616f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:06Z,use_quota=True,user_id='e9394d43ed13400d85e985e4520d32d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Creating volume 6fb39d20-581d-47d2-b2a4-22533a19deae {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:05 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:33:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:05 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae 1073741824 Jul 10 00:33:05 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:06 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae 1073741824" returned: 0 in 1.102s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:06 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae Jul 10 00:33:06 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:07 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae" returned: 0 in 0.887s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74eec758-0f36-4263-a5ff-1932c156c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb39d20-581d-47d2-b2a4-22533a19deae', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3f3652-e14c-41e4-a09f-1ad4817dca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:07 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Volume volume-6fb39d20-581d-47d2-b2a4-22533a19deae (6fb39d20-581d-47d2-b2a4-22533a19deae): created successfully Jul 10 00:33:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3f3652-e14c-41e4-a09f-1ad4817dca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Flow 'volume_create_manager' (b273d254-3fe4-49a0-a0c0-9d4ff656e95f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a947b84f-8b69-44d8-ac00-f8de2923e07c tempest-VolumeQuotasAdminTestJSON-274698301 None] Created volume successfully. Jul 10 00:33:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e67e3eda-4335-4625-918d-f6856ee86a07 tempest-VolumeQuotasAdminTestJSON-1963045521 None] Transfer volume completed successfully. Jul 10 00:33:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Acquiring lock "cinder-52ef441d-b8ef-4c02-8454-c01676ac02d3-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Lock "cinder-52ef441d-b8ef-4c02-8454-c01676ac02d3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Acquiring lock "cinder-quobyte-52ef441d-b8ef-4c02-8454-c01676ac02d3" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Lock "cinder-quobyte-52ef441d-b8ef-4c02-8454-c01676ac02d3" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d42605-20f3-4f0f-843b-fa75c20bb728]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:10 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 Jul 10 00:33:10 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:11 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3" returned: 0 in 0.987s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Acquiring lock "cinder-6fb39d20-581d-47d2-b2a4-22533a19deae-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:11 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3 Jul 10 00:33:11 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Lock "cinder-6fb39d20-581d-47d2-b2a4-22533a19deae-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Acquiring lock "cinder-quobyte-6fb39d20-581d-47d2-b2a4-22533a19deae" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Lock "cinder-quobyte-6fb39d20-581d-47d2-b2a4-22533a19deae" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecd3cc5-90e7-4e98-a9d0-cd48919e7167]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:11 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae Jul 10 00:33:11 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:11 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52ef441d-b8ef-4c02-8454-c01676ac02d3" returned: 0 in 0.905s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Lock "cinder-quobyte-52ef441d-b8ef-4c02-8454-c01676ac02d3" released by "delete_volume" :: held 1.949s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Created reservations ['ef3098e4-92c5-4244-8e0e-0679a0f8e8bb', 'c3a7d49a-7084-4124-a1e4-17498776c370', 'ea00ea18-0587-40eb-b002-81d2cb0a01dc', 'ad428af5-7d04-477f-bb29-df1e6441e7e0'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:12 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:33:12 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:12 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae" returned: 0 in 1.310s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:12 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae Jul 10 00:33:12 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:13 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.953s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Deleted volume successfully. Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34a834cb-70f0-4a2e-ae35-980a28fa0591 tempest-DeleteServersTestJSON-1180375202 None] Lock "cinder-52ef441d-b8ef-4c02-8454-c01676ac02d3-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:13 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6fb39d20-581d-47d2-b2a4-22533a19deae" returned: 0 in 0.921s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Lock "cinder-quobyte-6fb39d20-581d-47d2-b2a4-22533a19deae" released by "delete_volume" :: held 2.307s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Created reservations ['09b3f976-c7ec-49e6-96d0-f7946e5cfcc0', 'ccde5584-f941-4a97-857a-c32776d83e66', '06123585-dd20-47f3-bb5b-f8dc04729984', '1e11a751-eaf7-4d26-aa60-c6a46d4e09bb'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:13 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:33:13 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:14 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.758s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:14 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Deleted volume successfully. Jul 10 00:33:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-68e3ac16-a0c6-4076-8ec9-ab686b8b52ad tempest-VolumeQuotasAdminTestJSON-184252460 None] Lock "cinder-6fb39d20-581d-47d2-b2a4-22533a19deae-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Flow 'volume_create_manager' (fdfd5597-8a5d-426a-91ca-d37063a55ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36db829-1a16-4455-95d8-2d15273f0679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36db829-1a16-4455-95d8-2d15273f0679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1575681771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e78831-32c7-4a10-a229-8d1b82e444db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a6c560bfd149769a9897ced41385f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:23Z,use_quota=True,user_id='65fcfb067168464a8e20ee79e5bf22ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f58367-c5a2-4b26-adb4-39c047e7608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f58367-c5a2-4b26-adb4-39c047e7608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14f30db-175d-4b2d-8add-0e9586b91fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14f30db-175d-4b2d-8add-0e9586b91fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e78831-32c7-4a10-a229-8d1b82e444db', 'volume_name': 'volume-f5e78831-32c7-4a10-a229-8d1b82e444db', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b357e465-dcf8-466a-9d29-4ffa9ac2f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b357e465-dcf8-466a-9d29-4ffa9ac2f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa02273-3fc4-4afd-b805-bd59282ae114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:23 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Volume f5e78831-32c7-4a10-a229-8d1b82e444db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e78831-32c7-4a10-a229-8d1b82e444db', 'volume_size': 1} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1575681771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e78831-32c7-4a10-a229-8d1b82e444db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a6c560bfd149769a9897ced41385f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:23Z,use_quota=True,user_id='65fcfb067168464a8e20ee79e5bf22ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Creating volume f5e78831-32c7-4a10-a229-8d1b82e444db {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:23 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:33:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:23 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db 1073741824 Jul 10 00:33:23 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:24 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db 1073741824" returned: 0 in 1.001s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:24 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db Jul 10 00:33:24 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:25 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db" returned: 0 in 0.884s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa02273-3fc4-4afd-b805-bd59282ae114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e78831-32c7-4a10-a229-8d1b82e444db', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b56c6b7-7085-4a0c-90b9-db1b051819e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:25 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Volume volume-f5e78831-32c7-4a10-a229-8d1b82e444db (f5e78831-32c7-4a10-a229-8d1b82e444db): created successfully Jul 10 00:33:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b56c6b7-7085-4a0c-90b9-db1b051819e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Flow 'volume_create_manager' (fdfd5597-8a5d-426a-91ca-d37063a55ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-daa8da7a-738d-44a2-8cbc-5b89a493dc9d tempest-TaggedAttachmentsTest-2097040570 None] Created volume successfully. Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Flow 'volume_create_manager' (8a37fd62-c9bd-4903-b9bc-0ca0394c5526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a877a144-9335-4d44-8d1d-2ce5080e3669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a877a144-9335-4d44-8d1d-2ce5080e3669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1430347877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fb12da-735c-4b7a-b339-e4466ce1ab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2244ddff308444009a20c6818a1b023b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:28Z,use_quota=True,user_id='671937d0a1d84c03ad5f85a546e64469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a7bf2e-6d39-4752-9e2e-f529c3bce5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a7bf2e-6d39-4752-9e2e-f529c3bce5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e87a1f-570c-47b6-8b31-fa10edee451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e87a1f-570c-47b6-8b31-fa10edee451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fb12da-735c-4b7a-b339-e4466ce1ab5d', 'volume_name': 'volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed43e88-e328-4c06-8d30-a449a43f44b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed43e88-e328-4c06-8d30-a449a43f44b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7414d2b2-4f1f-4b2d-9e30-c0e30a08ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:28 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Volume 52fb12da-735c-4b7a-b339-e4466ce1ab5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d', 'volume_size': 1} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1430347877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fb12da-735c-4b7a-b339-e4466ce1ab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2244ddff308444009a20c6818a1b023b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:28Z,use_quota=True,user_id='671937d0a1d84c03ad5f85a546e64469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Creating volume 52fb12da-735c-4b7a-b339-e4466ce1ab5d {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:28 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:33:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:28 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d 1073741824 Jul 10 00:33:28 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:29 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d 1073741824" returned: 0 in 0.966s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:29 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=61,cinder:UPDATE=71,cinder:DELETE=5,cinder:INSERT=21 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:33:29 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=64,cinder:UPDATE=89,cinder:DELETE=8,cinder:INSERT=17 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:33:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:29 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d Jul 10 00:33:29 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:30 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d" returned: 0 in 0.884s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7414d2b2-4f1f-4b2d-9e30-c0e30a08ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cb6a18-ea01-4485-8bbe-2137df5ca2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:30 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Volume volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d (52fb12da-735c-4b7a-b339-e4466ce1ab5d): created successfully Jul 10 00:33:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cb6a18-ea01-4485-8bbe-2137df5ca2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Flow 'volume_create_manager' (8a37fd62-c9bd-4903-b9bc-0ca0394c5526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8ef0bda3-b1a5-4325-a0d1-abad0c6e73da tempest-VolumesServicesTestJSON-835475455 None] Created volume successfully. Jul 10 00:33:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Acquiring lock "cinder-52fb12da-735c-4b7a-b339-e4466ce1ab5d-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Lock "cinder-52fb12da-735c-4b7a-b339-e4466ce1ab5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Acquiring lock "cinder-quobyte-52fb12da-735c-4b7a-b339-e4466ce1ab5d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Lock "cinder-quobyte-52fb12da-735c-4b7a-b339-e4466ce1ab5d" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:31 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30f3d5c-62b8-467f-aa42-9a609a07339d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:32 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d Jul 10 00:33:32 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:33 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d" returned: 0 in 1.024s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:33 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d Jul 10 00:33:33 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:33 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52fb12da-735c-4b7a-b339-e4466ce1ab5d" returned: 0 in 0.757s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Lock "cinder-quobyte-52fb12da-735c-4b7a-b339-e4466ce1ab5d" released by "delete_volume" :: held 1.831s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Created reservations ['fc8ac6a7-87a3-4755-bb5b-84645ef23f5a', '3d1f24d5-953f-42b0-9ed5-06ad5cb21c77', '560e1b11-6252-42ed-8732-d37794a83222', '89a0a937-07ce-452b-bbdc-9719f844f266'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:33 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:33:33 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:34 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.862s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:34 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Deleted volume successfully. Jul 10 00:33:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3eaf38a7-6df2-4fba-8c03-8af218bf1777 tempest-VolumesServicesTestJSON-835475455 None] Lock "cinder-52fb12da-735c-4b7a-b339-e4466ce1ab5d-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:43 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=9,cinder:DELETE=1,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:33:44 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Flow 'volume_create_manager' (179e2979-40ea-4cc3-aeb2-7a1783abb194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb637c2-a09e-4426-a740-f72d4215de81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb637c2-a09e-4426-a740-f72d4215de81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2079088357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9625c3b4a6b4bbda8d58647812c9e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:45Z,use_quota=True,user_id='58fdc9a850b14193960235e909cd4c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89fabbe-429d-40c2-8bd3-df46611ead31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89fabbe-429d-40c2-8bd3-df46611ead31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12cad0a-97fd-4394-b7bf-be1f9d853da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12cad0a-97fd-4394-b7bf-be1f9d853da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d', 'volume_name': 'volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861ce322-999e-4357-9ad5-e343b4ec2024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861ce322-999e-4357-9ad5-e343b4ec2024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa7d44f-9dde-42f2-8023-ab1e1e77d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Volume 2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d', 'volume_size': 1} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2079088357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9625c3b4a6b4bbda8d58647812c9e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:45Z,use_quota=True,user_id='58fdc9a850b14193960235e909cd4c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Creating volume 2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:45 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:33:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:45 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d 1073741824 Jul 10 00:33:45 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:46 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d 1073741824" returned: 0 in 1.295s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:46 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d Jul 10 00:33:46 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:48 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" returned: 0 in 1.443s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] <== create_volume: return (2885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.892s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa7d44f-9dde-42f2-8023-ab1e1e77d7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e86d4f3-f613-48a2-947a-5d6a0f1ec814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Volume volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d (2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d): created successfully Jul 10 00:33:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e86d4f3-f613-48a2-947a-5d6a0f1ec814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Flow 'volume_create_manager' (179e2979-40ea-4cc3-aeb2-7a1783abb194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4a8d4da4-aad9-4acf-b88d-eb31d625c4a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Created volume successfully. Jul 10 00:33:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:49 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Creating offline snapshot 64ef7277-fafe-45e8-a0b4-c61bc65f37c9 of volume 2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:33:50 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966382e-2d2b-4355-9553-4d9b2d285dbc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:50 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d Jul 10 00:33:50 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:51 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" returned: 0 in 1.333s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:51 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 1G Jul 10 00:33:51 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:52 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 1G" returned: 0 in 1.185s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:52 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 Jul 10 00:33:52 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:53 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:33:53 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:53 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9" returned: 0 in 1.108s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:53 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 is being set with open permissions: ugo+rw Jul 10 00:33:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:53 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 Jul 10 00:33:53 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:54 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9" returned: 0 in 0.853s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:54 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.info Jul 10 00:33:54 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:54 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.323s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:33:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 8 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:33:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:33:56 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.info" returned: 0 in 1.459s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:56 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.info is being set with open permissions: ugo+rw Jul 10 00:33:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:56 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.info Jul 10 00:33:56 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:57 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.info" returned: 0 in 1.391s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.490s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-9757b2f0-d6e5-475d-88bf-a8be6ca425e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Create snapshot completed successfully Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "cinder-64ef7277-fafe-45e8-a0b4-c61bc65f37c9-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-64ef7277-fafe-45e8-a0b4-c61bc65f37c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "cinder-quobyte-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-quobyte-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "cinder-quobyte-64ef7277-fafe-45e8-a0b4-c61bc65f37c9" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-quobyte-64ef7277-fafe-45e8-a0b4-c61bc65f37c9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Deleting offline snapshot 64ef7277-fafe-45e8-a0b4-c61bc65f37c9 of volume 2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] snapshot_file for this snap is: volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6557cb6f-66ac-4470-93ef-280207acf705]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:59 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 Jul 10 00:33:59 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:59 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9" returned: 0 in 0.823s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:59 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab31366-517f-464d-8162-9821e7f8f92a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:59 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d Jul 10 00:33:59 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:00 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:00 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 Jul 10 00:34:00 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:01 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9" returned: 0 in 1.114s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:01 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9 Jul 10 00:34:01 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:02 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d.64ef7277-fafe-45e8-a0b4-c61bc65f37c9" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-quobyte-64ef7277-fafe-45e8-a0b4-c61bc65f37c9" released by "_delete_snapshot" :: held 3.585s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-quobyte-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" released by "delete_snapshot" :: held 3.611s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:02 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Created reservations ['e70e2547-848d-4df1-9ca4-eeb35e809f29', '7418a19e-7de3-47ca-8d87-9d3f6f286646', 'fbf020ab-fee9-4b0c-ae9f-4d3301ecd761', '456bfb44-1626-489b-b760-df4548cd653c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Delete snapshot completed successfully. Jul 10 00:34:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-da978ea0-6d37-4907-bc4f-c4f9b9394e66 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-64ef7277-fafe-45e8-a0b4-c61bc65f37c9-delete_snapshot" released by "delete_snapshot" :: held 3.776s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "cinder-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "cinder-quobyte-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-quobyte-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e148309d-7647-472e-90f5-242d6e7b1fe9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:03 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d Jul 10 00:34:03 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:04 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" returned: 0 in 1.101s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:04 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d Jul 10 00:34:04 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:05 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-quobyte-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d" released by "delete_volume" :: held 1.877s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Created reservations ['a05a7be1-8f64-4594-bd25-fffb4b7fb824', 'ea302806-366b-4b06-a856-64c98b1d36e4', 'd06c7282-ecf1-4aae-b65a-751c2c0fba42', 'eb1564e6-8b40-4f83-a3e1-22417d51c542'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:05 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:34:05 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:06 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.001s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:06 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Deleted volume successfully. Jul 10 00:34:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c36e6459-f981-41cb-9518-cfb74ab266f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547448687 None] Lock "cinder-2c2edc2d-fc7d-4d7a-a0f7-5aa4cc868a1d-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Flow 'volume_create_manager' (c2ab7a0e-9dc4-4ab8-bc7d-5bbf4cc524a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4a7386-a52b-44ff-b43b-f5342e9f25f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4a7386-a52b-44ff-b43b-f5342e9f25f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-915988180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4402b886-e2b8-4f44-9e89-099d6d50c854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29deb56a39140d7acd673c91154867e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:12Z,use_quota=True,user_id='c6d83738e5cc41dd96afe93e2a66847f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d73b677-0a0b-48e7-b2ae-4d13dbee5302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d73b677-0a0b-48e7-b2ae-4d13dbee5302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f750aeb-86db-495d-9bae-ae3de78123ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f750aeb-86db-495d-9bae-ae3de78123ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4402b886-e2b8-4f44-9e89-099d6d50c854', 'volume_name': 'volume-4402b886-e2b8-4f44-9e89-099d6d50c854', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42d8e39-a665-48d1-b2ca-b6f2b1e1974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42d8e39-a665-48d1-b2ca-b6f2b1e1974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6559be0-ab08-4ddd-b91e-fa015011ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Volume 4402b886-e2b8-4f44-9e89-099d6d50c854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4402b886-e2b8-4f44-9e89-099d6d50c854', 'volume_size': 1} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-915988180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4402b886-e2b8-4f44-9e89-099d6d50c854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29deb56a39140d7acd673c91154867e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:12Z,use_quota=True,user_id='c6d83738e5cc41dd96afe93e2a66847f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Creating volume 4402b886-e2b8-4f44-9e89-099d6d50c854 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:11 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:11 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 1073741824 Jul 10 00:34:11 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Flow 'volume_create_manager' (62d90ebd-12eb-4da8-9b04-07a1cb85ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604c159d-2625-40f5-bd18-9b0d0de4f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604c159d-2625-40f5-bd18-9b0d0de4f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2125508529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7763ccae-4e03-48f0-9d6a-6200df9b4037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00aab8488d55438fac66f6b162e7464e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:12Z,use_quota=True,user_id='cb44ed2adc65441283414f6399f33e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3884613-62ef-49d8-ba7e-043d0caccb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3884613-62ef-49d8-ba7e-043d0caccb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6710a2f-2039-4416-bfc4-ba6593ea155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6710a2f-2039-4416-bfc4-ba6593ea155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7763ccae-4e03-48f0-9d6a-6200df9b4037', 'volume_name': 'volume-7763ccae-4e03-48f0-9d6a-6200df9b4037', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e44b2c-fde6-4bd4-a63f-de22f1826ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e44b2c-fde6-4bd4-a63f-de22f1826ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820e6df1-16ba-42a2-873c-602d7476ffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Volume 7763ccae-4e03-48f0-9d6a-6200df9b4037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7763ccae-4e03-48f0-9d6a-6200df9b4037', 'volume_size': 1} Jul 10 00:34:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:12 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 1073741824" returned: 0 in 0.938s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:12 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 Jul 10 00:34:12 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:13 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854" returned: 0 in 0.638s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2125508529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7763ccae-4e03-48f0-9d6a-6200df9b4037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00aab8488d55438fac66f6b162e7464e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:12Z,use_quota=True,user_id='cb44ed2adc65441283414f6399f33e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Creating volume 7763ccae-4e03-48f0-9d6a-6200df9b4037 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:13 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6559be0-ab08-4ddd-b91e-fa015011ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4402b886-e2b8-4f44-9e89-099d6d50c854', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c228bcd-1d1c-4b15-9b08-7101ff1cdb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:13 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 1073741824 Jul 10 00:34:13 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:13 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Volume volume-4402b886-e2b8-4f44-9e89-099d6d50c854 (4402b886-e2b8-4f44-9e89-099d6d50c854): created successfully Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c228bcd-1d1c-4b15-9b08-7101ff1cdb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Flow 'volume_create_manager' (c2ab7a0e-9dc4-4ab8-bc7d-5bbf4cc524a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d0bcf3bd-a5c5-43cf-b5e0-0fd0e4f07923 tempest-AttachVolumeTestJSON-416492636 None] Created volume successfully. Jul 10 00:34:14 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 1073741824" returned: 0 in 0.959s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:14 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 Jul 10 00:34:14 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:15 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037" returned: 0 in 0.801s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820e6df1-16ba-42a2-873c-602d7476ffb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7763ccae-4e03-48f0-9d6a-6200df9b4037', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b45c170-fb47-4846-8f8d-871069f3fc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:15 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Volume volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 (7763ccae-4e03-48f0-9d6a-6200df9b4037): created successfully Jul 10 00:34:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b45c170-fb47-4846-8f8d-871069f3fc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Flow 'volume_create_manager' (62d90ebd-12eb-4da8-9b04-07a1cb85ab16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:15 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c9293f06-a4fb-412c-b2e5-879584f52a7c tempest-VolumesListAdminTestJSON-979751549 None] Created volume successfully. Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Flow 'volume_create_manager' (9f0f2e7d-e8bb-447d-b030-212a56e6db26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c550290-945e-4e61-9b10-bcb429820d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c550290-945e-4e61-9b10-bcb429820d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-549837620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43a214b-36d3-4724-9cff-4faf45d8bcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00aab8488d55438fac66f6b162e7464e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:17Z,use_quota=True,user_id='cb44ed2adc65441283414f6399f33e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c30318-3cb9-4272-b359-ff684de15063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c30318-3cb9-4272-b359-ff684de15063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede052a7-cecf-492b-a7d1-5cc85b9cf863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede052a7-cecf-492b-a7d1-5cc85b9cf863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43a214b-36d3-4724-9cff-4faf45d8bcec', 'volume_name': 'volume-c43a214b-36d3-4724-9cff-4faf45d8bcec', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c1dfaa-d44e-4ff2-977c-a33e00408161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c1dfaa-d44e-4ff2-977c-a33e00408161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb73eae8-2e38-4f87-82be-5363cdaa3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:16 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Volume c43a214b-36d3-4724-9cff-4faf45d8bcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43a214b-36d3-4724-9cff-4faf45d8bcec', 'volume_size': 1} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-549837620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43a214b-36d3-4724-9cff-4faf45d8bcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00aab8488d55438fac66f6b162e7464e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:17Z,use_quota=True,user_id='cb44ed2adc65441283414f6399f33e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Creating volume c43a214b-36d3-4724-9cff-4faf45d8bcec {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:16 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:16 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec 1073741824 Jul 10 00:34:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-34730553-d843-4534-95d5-647d3e10734a req-8fc10c4b-e62c-4d61-b5f8-ecf7757e75ef tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:16 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:17 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec 1073741824" returned: 0 in 0.890s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:17 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec Jul 10 00:34:17 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:18 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec" returned: 0 in 0.614s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-34730553-d843-4534-95d5-647d3e10734a req-8fc10c4b-e62c-4d61-b5f8-ecf7757e75ef tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.506s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb73eae8-2e38-4f87-82be-5363cdaa3981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43a214b-36d3-4724-9cff-4faf45d8bcec', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3e9876-9e08-459b-a02f-c535e6af5907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd6690f-b3fb-4fec-9b58-1977e92f5787]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-34730553-d843-4534-95d5-647d3e10734a req-8fc10c4b-e62c-4d61-b5f8-ecf7757e75ef tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Volume volume-c43a214b-36d3-4724-9cff-4faf45d8bcec (c43a214b-36d3-4724-9cff-4faf45d8bcec): created successfully Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3e9876-9e08-459b-a02f-c535e6af5907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Flow 'volume_create_manager' (9f0f2e7d-e8bb-447d-b030-212a56e6db26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:18 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-79a7e83f-7e10-40ee-bb93-de1e523c1d23 tempest-VolumesListAdminTestJSON-979751549 None] Created volume successfully. Jul 10 00:34:18 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 Jul 10 00:34:18 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:19 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-34730553-d843-4534-95d5-647d3e10734a req-8fc10c4b-e62c-4d61-b5f8-ecf7757e75ef tempest-AttachVolumeTestJSON-416492636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854" returned: 0 in 0.808s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-34730553-d843-4534-95d5-647d3e10734a req-8fc10c4b-e62c-4d61-b5f8-ecf7757e75ef tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Flow 'volume_create_manager' (331309bb-df72-4032-abe6-5bf3e7985476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427cb208-7833-4227-ae0f-1a269f34fdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-34730553-d843-4534-95d5-647d3e10734a req-8fc10c4b-e62c-4d61-b5f8-ecf7757e75ef tempest-AttachVolumeTestJSON-416492636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-4402b886-e2b8-4f44-9e89-099d6d50c854', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b589927f-3c54-452e-b216-ccdd3228c6d9', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427cb208-7833-4227-ae0f-1a269f34fdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949318966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee061ef-f864-468f-bd91-651433d8be05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00aab8488d55438fac66f6b162e7464e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:19Z,use_quota=True,user_id='cb44ed2adc65441283414f6399f33e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce70cc6-c7ee-4705-8443-5c916ba4f619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce70cc6-c7ee-4705-8443-5c916ba4f619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ece954-b53d-4cb8-bab0-3c99f03e522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ece954-b53d-4cb8-bab0-3c99f03e522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee061ef-f864-468f-bd91-651433d8be05', 'volume_name': 'volume-aee061ef-f864-468f-bd91-651433d8be05', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db65ffb-2977-4510-a197-e2dad91b5a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db65ffb-2977-4510-a197-e2dad91b5a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc5ac3a-9200-4945-a4ee-3ce79b1f50a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Volume aee061ef-f864-468f-bd91-651433d8be05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee061ef-f864-468f-bd91-651433d8be05', 'volume_size': 1} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949318966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee061ef-f864-468f-bd91-651433d8be05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00aab8488d55438fac66f6b162e7464e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:19Z,use_quota=True,user_id='cb44ed2adc65441283414f6399f33e3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Creating volume aee061ef-f864-468f-bd91-651433d8be05 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:19 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:34:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:19 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 1073741824 Jul 10 00:34:19 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-34730553-d843-4534-95d5-647d3e10734a req-8fc10c4b-e62c-4d61-b5f8-ecf7757e75ef tempest-AttachVolumeTestJSON-416492636 None] attachment_update completed successfully. Jul 10 00:34:20 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 1073741824" returned: 0 in 1.110s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:20 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 Jul 10 00:34:20 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:21 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05" returned: 0 in 0.655s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc5ac3a-9200-4945-a4ee-3ce79b1f50a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee061ef-f864-468f-bd91-651433d8be05', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0094097-6463-4435-b2bf-11c61f1af58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:21 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Volume volume-aee061ef-f864-468f-bd91-651433d8be05 (aee061ef-f864-468f-bd91-651433d8be05): created successfully Jul 10 00:34:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0094097-6463-4435-b2bf-11c61f1af58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Flow 'volume_create_manager' (331309bb-df72-4032-abe6-5bf3e7985476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-182ab325-b251-4589-974b-41a6fd236811 tempest-VolumesListAdminTestJSON-979751549 None] Created volume successfully. Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Flow 'volume_create_manager' (b6c8f43d-5f71-44ee-a334-e00a04084ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36868990-92fa-47eb-a259-4cb705acb932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36868990-92fa-47eb-a259-4cb705acb932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e38126-5e4a-47b7-a34d-679fd6e873e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343ea792c8864d1cbb64a3a163cb6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:22Z,use_quota=True,user_id='b27684d8854d4c4f9180cfc3f4b21ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5abcec-9eb5-41fb-b5ba-04a7bf224106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5abcec-9eb5-41fb-b5ba-04a7bf224106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a70958-ffa3-4ac2-878b-06412f1c2499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a70958-ffa3-4ac2-878b-06412f1c2499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e38126-5e4a-47b7-a34d-679fd6e873e5', 'volume_name': 'volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f49820-42d0-46f1-8c63-46c0e6f34fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f49820-42d0-46f1-8c63-46c0e6f34fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fd190c-1263-4bf2-a4ea-f3ac728a83c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:22 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Volume b1e38126-5e4a-47b7-a34d-679fd6e873e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5', 'volume_size': 1} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e38126-5e4a-47b7-a34d-679fd6e873e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343ea792c8864d1cbb64a3a163cb6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:22Z,use_quota=True,user_id='b27684d8854d4c4f9180cfc3f4b21ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Creating volume b1e38126-5e4a-47b7-a34d-679fd6e873e5 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:22 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:22 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 1073741824 Jul 10 00:34:22 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:22 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 1073741824" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:22 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 Jul 10 00:34:22 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:23 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5" returned: 0 in 0.658s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fd190c-1263-4bf2-a4ea-f3ac728a83c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c362cb-2a33-4103-92ba-fa867e77d9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:23 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Volume volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 (b1e38126-5e4a-47b7-a34d-679fd6e873e5): created successfully Jul 10 00:34:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c362cb-2a33-4103-92ba-fa867e77d9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Flow 'volume_create_manager' (b6c8f43d-5f71-44ee-a334-e00a04084ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8fdb7dc8-a63a-48f3-8fc3-670ab636a5f4 tempest-VolumesListAdminTestJSON-2062150305 None] Created volume successfully. Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Acquiring lock "cinder-b1e38126-5e4a-47b7-a34d-679fd6e873e5-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "cinder-b1e38126-5e4a-47b7-a34d-679fd6e873e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Acquiring lock "cinder-quobyte-b1e38126-5e4a-47b7-a34d-679fd6e873e5" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "cinder-quobyte-b1e38126-5e4a-47b7-a34d-679fd6e873e5" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[772c2250-e023-4f43-a3e5-23bd53e86f56]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "cinder-aee061ef-f864-468f-bd91-651433d8be05-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-aee061ef-f864-468f-bd91-651433d8be05-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "cinder-quobyte-aee061ef-f864-468f-bd91-651433d8be05" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-quobyte-aee061ef-f864-468f-bd91-651433d8be05" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:24 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 Jul 10 00:34:24 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c087d04-6449-4cc3-9bdc-27123fa2ff98]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:24 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 Jul 10 00:34:24 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:25 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5" returned: 0 in 0.877s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:25 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5 Jul 10 00:34:25 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:25 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05" returned: 0 in 0.808s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:25 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05 Jul 10 00:34:25 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:26 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b1e38126-5e4a-47b7-a34d-679fd6e873e5" returned: 0 in 0.873s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "cinder-quobyte-b1e38126-5e4a-47b7-a34d-679fd6e873e5" released by "delete_volume" :: held 1.813s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Created reservations ['01b8dff1-c777-46fb-8419-3fc0a8397235', '0e3da7ad-6ccb-4660-8357-1c0ee6d20fb9', '5f2e410e-9890-43f2-9192-794df61c5d9d', '9d5891fa-7b9f-4eb8-9b4c-043b14dfeb56'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:26 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-aee061ef-f864-468f-bd91-651433d8be05" returned: 0 in 0.912s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:26 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:34:26 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-quobyte-aee061ef-f864-468f-bd91-651433d8be05" released by "delete_volume" :: held 1.775s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Created reservations ['af209793-5aef-4e1c-8590-4fc245e27198', '28b36c5a-39cb-4fc0-a81c-c4818f82b5c8', '5bf80847-dee6-4e0d-8667-b023920d6a18', '10d6a5a8-2d16-4d99-bf45-4f497adee75a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:26 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:34:26 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "cinder-c43a214b-36d3-4724-9cff-4faf45d8bcec-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-c43a214b-36d3-4724-9cff-4faf45d8bcec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "cinder-quobyte-c43a214b-36d3-4724-9cff-4faf45d8bcec" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-quobyte-c43a214b-36d3-4724-9cff-4faf45d8bcec" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[781773f9-f2c0-4c77-a4d3-f0bd61f9ab30]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:27 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.824s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Deleted volume successfully. Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f04a7ff1-ef89-4763-a05e-c5d43423c560 req-82becdfa-654c-4953-9483-cf92de6c6c87 tempest-TaggedAttachmentsTest-2097040570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f04a7ff1-ef89-4763-a05e-c5d43423c560 req-82becdfa-654c-4953-9483-cf92de6c6c87 tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b60a6e-3f89-4d5c-8ec0-20d2b45b1562]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f04a7ff1-ef89-4763-a05e-c5d43423c560 req-82becdfa-654c-4953-9483-cf92de6c6c87 tempest-TaggedAttachmentsTest-2097040570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:27 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec Jul 10 00:34:27 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9254524-241e-47e1-b9f1-98d4d0f3d725 tempest-VolumesListAdminTestJSON-2062150305 None] Lock "cinder-b1e38126-5e4a-47b7-a34d-679fd6e873e5-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:27 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db Jul 10 00:34:27 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:27 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.952s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Deleted volume successfully. Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-26cf3dfd-9906-49b1-9536-006e2e676817 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-aee061ef-f864-468f-bd91-651433d8be05-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:27 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec" returned: 0 in 1.030s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:27 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec Jul 10 00:34:27 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Flow 'volume_create_manager' (17350df6-5261-4af8-974f-ba680e0a7550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:28 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd0bf92-d918-4354-9404-5a0ee44e71e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f04a7ff1-ef89-4763-a05e-c5d43423c560 req-82becdfa-654c-4953-9483-cf92de6c6c87 tempest-TaggedAttachmentsTest-2097040570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db" returned: 0 in 1.020s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f04a7ff1-ef89-4763-a05e-c5d43423c560 req-82becdfa-654c-4953-9483-cf92de6c6c87 tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.048s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd0bf92-d918-4354-9404-5a0ee44e71e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1837995240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4503a08-0ce9-44a1-82bb-3038556eca13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ae044b34a64cf2898eb3fac4bec5cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:28Z,use_quota=True,user_id='d6413e9120314b9bad5edd099a489225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f07834e-9860-4b78-ad69-79554a5b509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f07834e-9860-4b78-ad69-79554a5b509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbb5b76-9b65-430f-852b-6414c088740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbb5b76-9b65-430f-852b-6414c088740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4503a08-0ce9-44a1-82bb-3038556eca13', 'volume_name': 'volume-c4503a08-0ce9-44a1-82bb-3038556eca13', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028a5dca-e861-4e5e-a143-e5403c25edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028a5dca-e861-4e5e-a143-e5403c25edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c2ee30-a283-4bfa-9e2f-14276676b617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:28 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Volume c4503a08-0ce9-44a1-82bb-3038556eca13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4503a08-0ce9-44a1-82bb-3038556eca13', 'volume_size': 1} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1837995240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4503a08-0ce9-44a1-82bb-3038556eca13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ae044b34a64cf2898eb3fac4bec5cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:28Z,use_quota=True,user_id='d6413e9120314b9bad5edd099a489225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Creating volume c4503a08-0ce9-44a1-82bb-3038556eca13 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:28 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:28 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 1073741824 Jul 10 00:34:28 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-f04a7ff1-ef89-4763-a05e-c5d43423c560 req-82becdfa-654c-4953-9483-cf92de6c6c87 tempest-TaggedAttachmentsTest-2097040570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-f5e78831-32c7-4a10-a229-8d1b82e444db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbfe2b64-f52d-4db2-9e85-eff140e0b5cb', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:34:28 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-f04a7ff1-ef89-4763-a05e-c5d43423c560 req-82becdfa-654c-4953-9483-cf92de6c6c87 tempest-TaggedAttachmentsTest-2097040570 None] attachment_update completed successfully. Jul 10 00:34:28 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c43a214b-36d3-4724-9cff-4faf45d8bcec" returned: 0 in 0.817s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-quobyte-c43a214b-36d3-4724-9cff-4faf45d8bcec" released by "delete_volume" :: held 1.906s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Created reservations ['0fe3d101-8536-47e1-b415-006dd22bad42', 'b761c211-c4b9-40b7-965e-92bbdd82f49a', 'b440781b-0b86-4533-b8f7-bfc9d89e0a55', '6a56a5f8-e754-47fd-baeb-5131196ef549'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:29 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:34:29 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "cinder-7763ccae-4e03-48f0-9d6a-6200df9b4037-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-7763ccae-4e03-48f0-9d6a-6200df9b4037-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "cinder-quobyte-7763ccae-4e03-48f0-9d6a-6200df9b4037" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-quobyte-7763ccae-4e03-48f0-9d6a-6200df9b4037" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:29 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 1073741824" returned: 0 in 1.183s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[386e88af-8a11-419f-8e1e-c10a6806a6af]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:29 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 Jul 10 00:34:29 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:29 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 Jul 10 00:34:29 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:30 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.094s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Deleted volume successfully. Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-662a1b3d-96b8-4ab2-9a1c-ea30dba68f83 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-c43a214b-36d3-4724-9cff-4faf45d8bcec-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:30 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13" returned: 0 in 0.937s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c2ee30-a283-4bfa-9e2f-14276676b617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4503a08-0ce9-44a1-82bb-3038556eca13', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218216e5-ce74-40e8-8df3-cfcd6dacec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:30 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Volume volume-c4503a08-0ce9-44a1-82bb-3038556eca13 (c4503a08-0ce9-44a1-82bb-3038556eca13): created successfully Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218216e5-ce74-40e8-8df3-cfcd6dacec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Flow 'volume_create_manager' (17350df6-5261-4af8-974f-ba680e0a7550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a575dd2c-8fcc-4c1f-9ba5-bfb7db04c89b tempest-ServerActionsTestOtherA-2007018710 None] Created volume successfully. Jul 10 00:34:30 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037" returned: 0 in 1.103s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:30 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037 Jul 10 00:34:30 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:31 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7763ccae-4e03-48f0-9d6a-6200df9b4037" returned: 0 in 0.711s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-quobyte-7763ccae-4e03-48f0-9d6a-6200df9b4037" released by "delete_volume" :: held 1.896s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Created reservations ['5164f671-3cb8-4ab2-a46a-4b5496014d94', '6c9dd054-4167-45a2-b659-e7e793f65cf3', 'a7f4e8e7-586e-4c54-8170-674068330ffc', '68761b65-b4c0-4bc0-aa5f-dcdd313682cb'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:31 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:34:31 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:32 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Deleted volume successfully. Jul 10 00:34:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8929c124-0269-4fe5-8c0b-e0e96abe6183 tempest-VolumesListAdminTestJSON-979751549 None] Lock "cinder-7763ccae-4e03-48f0-9d6a-6200df9b4037-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-edb959bd-c977-4829-a937-569fe91e20af req-42c9db9d-5f4d-4f42-9453-0e56e9d9fd84 tempest-TaggedAttachmentsTest-2097040570 None] Terminate volume connection completed successfully. Jul 10 00:34:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-edb959bd-c977-4829-a937-569fe91e20af req-42c9db9d-5f4d-4f42-9453-0e56e9d9fd84 tempest-TaggedAttachmentsTest-2097040570 None] Deleting attachment fbfe2b64-f52d-4db2-9e85-eff140e0b5cb. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Flow 'volume_create_manager' (78df3f9f-5191-45f4-8df1-77934ccaee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0300f70a-0a26-427c-b3d7-e649e0de1400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0300f70a-0a26-427c-b3d7-e649e0de1400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1626092463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80587ed9-5c0c-413b-8f53-8f18fe6f7175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4b10f583964c18b61642d0d52c716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:41Z,use_quota=True,user_id='d0ecc2bb26074578b791a16fb40ed088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aca72f-db56-4c93-be57-60e5e3b6ef86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aca72f-db56-4c93-be57-60e5e3b6ef86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727baa36-ff32-46e1-a89e-80f90a6d785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727baa36-ff32-46e1-a89e-80f90a6d785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80587ed9-5c0c-413b-8f53-8f18fe6f7175', 'volume_name': 'volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb84a5e9-69ab-4365-a57c-ef0661ea69e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb84a5e9-69ab-4365-a57c-ef0661ea69e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2891882-65da-4491-818c-fd73408ba60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:41 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Volume 80587ed9-5c0c-413b-8f53-8f18fe6f7175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175', 'volume_size': 1} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1626092463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80587ed9-5c0c-413b-8f53-8f18fe6f7175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4b10f583964c18b61642d0d52c716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:41Z,use_quota=True,user_id='d0ecc2bb26074578b791a16fb40ed088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Creating volume 80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:41 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:34:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:41 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 1073741824 Jul 10 00:34:41 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:42 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 1073741824" returned: 0 in 0.989s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:42 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 Jul 10 00:34:42 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:43 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175" returned: 0 in 0.938s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2891882-65da-4491-818c-fd73408ba60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dd7985-1087-4751-9a69-256ba7862fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:43 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Volume volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 (80587ed9-5c0c-413b-8f53-8f18fe6f7175): created successfully Jul 10 00:34:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dd7985-1087-4751-9a69-256ba7862fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Flow 'volume_create_manager' (78df3f9f-5191-45f4-8df1-77934ccaee95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:43 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-59b2803a-fd86-43f2-9120-42ba9830f41e tempest-VolumesDeleteCascade-1046606080 None] Created volume successfully. Jul 10 00:34:44 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=71,cinder:SELECT=67,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:34:44 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=58,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=16 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:34:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Creating offline snapshot d1b44d5d-30cb-4fed-92ec-8da649c88d57 of volume 80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:34:45 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e5380-dd2b-4d18-96dc-6ec4f2e5efec]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:45 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 Jul 10 00:34:45 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:45 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175" returned: 0 in 0.850s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:45 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 1G Jul 10 00:34:45 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:46 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 1G" returned: 0 in 1.075s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:46 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 Jul 10 00:34:46 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:48 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57" returned: 0 in 1.276s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:48 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 is being set with open permissions: ugo+rw Jul 10 00:34:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:48 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 Jul 10 00:34:48 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:49 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57" returned: 0 in 1.103s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:49 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.info Jul 10 00:34:49 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:50 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.info" returned: 0 in 0.901s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:50 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.info is being set with open permissions: ugo+rw Jul 10 00:34:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:50 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.info Jul 10 00:34:50 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:50 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.info" returned: 0 in 0.696s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-404bee74-c94b-4e7e-a539-3bb6d19ebe69 tempest-VolumesDeleteCascade-1046606080 None] Create snapshot completed successfully Jul 10 00:34:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Creating offline snapshot d8483cb7-7ea8-45db-90ee-a9976d34d3e5 of volume 80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:34:51 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db5dee9-fa51-4cba-be9f-e3d1164d79e7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:51 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 Jul 10 00:34:51 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:52 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57" returned: 0 in 0.908s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:52 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 1G Jul 10 00:34:52 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:53 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 1G" returned: 0 in 1.028s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:53 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 Jul 10 00:34:53 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:53 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:34:53 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:54 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5" returned: 0 in 0.855s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:54 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 is being set with open permissions: ugo+rw Jul 10 00:34:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:54 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 Jul 10 00:34:54 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:54 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.978s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:34:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 8 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:34:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:34:55 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5" returned: 0 in 0.695s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1bfadd8b-e0d3-4cd9-94bf-e660e5eeea41 tempest-VolumesDeleteCascade-1046606080 None] Create snapshot completed successfully Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-80587ed9-5c0c-413b-8f53-8f18fe6f7175-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-80587ed9-5c0c-413b-8f53-8f18fe6f7175-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Acquiring lock "cinder-f5e78831-32c7-4a10-a229-8d1b82e444db-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Lock "cinder-f5e78831-32c7-4a10-a229-8d1b82e444db-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Performing cascade delete. {{(pid=87452) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-d1b44d5d-30cb-4fed-92ec-8da649c88d57-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Acquiring lock "cinder-quobyte-f5e78831-32c7-4a10-a229-8d1b82e444db" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-d1b44d5d-30cb-4fed-92ec-8da649c88d57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Lock "cinder-quobyte-f5e78831-32c7-4a10-a229-8d1b82e444db" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-d1b44d5d-30cb-4fed-92ec-8da649c88d57" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1926b38f-d1cf-44f0-9554-73425fdf2d19]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-d1b44d5d-30cb-4fed-92ec-8da649c88d57" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Deleting offline snapshot d1b44d5d-30cb-4fed-92ec-8da649c88d57 of volume 80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] snapshot_file for this snap is: volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e2e6f0-8467-4ee2-a9f5-40994fabb4f3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:56 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db Jul 10 00:34:56 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:56 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 Jul 10 00:34:56 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:56 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db" returned: 0 in 0.839s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:56 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db Jul 10 00:34:56 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:56 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57" returned: 0 in 0.846s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[179fe547-f116-4f2a-9b80-338e1a0cabb4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:57 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 Jul 10 00:34:57 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:57 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f5e78831-32c7-4a10-a229-8d1b82e444db" returned: 0 in 0.664s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Lock "cinder-quobyte-f5e78831-32c7-4a10-a229-8d1b82e444db" released by "delete_volume" :: held 1.555s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Created reservations ['4509d73a-aa90-4a6e-9d97-638e32a8b237', '6e815143-2bce-4310-8c06-389bced69e49', '66323cb8-381a-44f6-ab25-5e45fd951f52', '017cd2ec-ce8d-41d5-9e14-e06c2c21dde5'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:57 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:34:57 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:57 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175" returned: 0 in 0.891s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe10ad74-4bd9-40d3-949b-025d29272dd1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:57 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 Jul 10 00:34:57 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:58 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.813s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:58 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Deleted volume successfully. Jul 10 00:34:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2bacdeba-379b-408c-bbf9-e971d604ef9e tempest-TaggedAttachmentsTest-2097040570 None] Lock "cinder-f5e78831-32c7-4a10-a229-8d1b82e444db-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:58 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5" returned: 0 in 0.896s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d91d8-c0e0-4b18-b269-ce2ec921377b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:58 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 Jul 10 00:34:58 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:59 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57" returned: 0 in 0.845s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:59 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[065f0e56-5a00-4d2b-9587-10e282a734f8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:59 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 Jul 10 00:34:59 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:00 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175" returned: 0 in 0.796s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:00 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 Jul 10 00:35:00 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:01 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57" returned: 0 in 0.841s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:01 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57 Jul 10 00:35:01 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:02 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d1b44d5d-30cb-4fed-92ec-8da649c88d57" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 -F qcow2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:02 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 -F qcow2 Jul 10 00:35:02 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:02 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 -F qcow2" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-d1b44d5d-30cb-4fed-92ec-8da649c88d57" released by "_delete_snapshot" :: held 6.790s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" released by "delete_snapshot" :: held 6.825s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Created reservations ['bb4d48c8-5bb4-4753-b2a1-bf010adada5c', '2e9983d1-4fcb-4061-88dd-fda09f26be53', 'e903d8aa-5aa8-412e-8d37-eeace9bfd037', '981ac3cd-b45b-498f-8854-8f77ebfdf457'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Delete snapshot completed successfully. Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-d1b44d5d-30cb-4fed-92ec-8da649c88d57-delete_snapshot" released by "delete_snapshot" :: held 7.030s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-d8483cb7-7ea8-45db-90ee-a9976d34d3e5-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-d8483cb7-7ea8-45db-90ee-a9976d34d3e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-d8483cb7-7ea8-45db-90ee-a9976d34d3e5" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-d8483cb7-7ea8-45db-90ee-a9976d34d3e5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Deleting offline snapshot d8483cb7-7ea8-45db-90ee-a9976d34d3e5 of volume 80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] snapshot_file for this snap is: volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1fab24-9c8a-450f-baaf-34405877e129]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:03 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 Jul 10 00:35:03 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:03 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5" returned: 0 in 0.913s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:35:04 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9776b49-30c9-4e54-b2d8-25d23f2f797d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:04 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 Jul 10 00:35:04 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:05 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175" returned: 0 in 1.069s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:05 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 Jul 10 00:35:05 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:05 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5" returned: 0 in 0.851s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:05 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5 Jul 10 00:35:05 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:06 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175.d8483cb7-7ea8-45db-90ee-a9976d34d3e5" returned: 0 in 0.693s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-d8483cb7-7ea8-45db-90ee-a9976d34d3e5" released by "_delete_snapshot" :: held 3.660s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" released by "delete_snapshot" :: held 3.688s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Created reservations ['db9c21f5-3a03-49a5-98db-ddd526741bc7', '21f7dc06-5d22-4e34-9b37-503a7cbabb84', 'fd46eaa5-278a-43ae-9fad-01cb973c8e92', 'b844b01e-3732-4309-bb7b-69c0f3109c7b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Delete snapshot completed successfully. Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-d8483cb7-7ea8-45db-90ee-a9976d34d3e5-delete_snapshot" released by "delete_snapshot" :: held 3.859s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Snapshots deleted, issuing volume delete {{(pid=87452) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d6dd5-3c55-4e1d-aac6-3e85cbaeda0c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:07 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 Jul 10 00:35:07 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:07 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175" returned: 0 in 0.902s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:07 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175 Jul 10 00:35:07 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:08 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-80587ed9-5c0c-413b-8f53-8f18fe6f7175" returned: 0 in 0.672s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-80587ed9-5c0c-413b-8f53-8f18fe6f7175" released by "delete_volume" :: held 1.646s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Created reservations ['9fb79af8-b074-44bb-91a1-ee78360227d7', '07baff53-ae9d-44e8-9012-1593fd07ff78', '93e34cf8-a6d3-4a4c-94d1-f85eb399c3e3', '3f48ada9-7eed-4b8f-a03b-a2ceb501e6bb'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:08 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:35:08 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:09 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.689s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Deleted volume successfully. Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-33b4628c-45f2-45a3-a61d-8a74ea0cc5d9 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-80587ed9-5c0c-413b-8f53-8f18fe6f7175-delete_volume" released by "delete_volume" :: held 13.590s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Flow 'volume_create_manager' (9966ed0f-aa60-4c25-93c3-5eb691e786ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39563f9a-e0a0-4dc2-921b-9289ff567fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39563f9a-e0a0-4dc2-921b-9289ff567fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-68855635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4b10f583964c18b61642d0d52c716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:10Z,use_quota=True,user_id='d0ecc2bb26074578b791a16fb40ed088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badc154b-8a56-47dd-8701-6078eecbe98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badc154b-8a56-47dd-8701-6078eecbe98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2dbdbd-9bf0-4e81-9137-280c45bb8e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2dbdbd-9bf0-4e81-9137-280c45bb8e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4', 'volume_name': 'volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c38401e-1810-4596-bfa0-af639693707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c38401e-1810-4596-bfa0-af639693707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7f854e-f26f-4b37-acd2-b47cf7fb2264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:09 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Volume 2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4', 'volume_size': 1} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-68855635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4b10f583964c18b61642d0d52c716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:10Z,use_quota=True,user_id='d0ecc2bb26074578b791a16fb40ed088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Creating volume 2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:09 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:35:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:09 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 1073741824 Jul 10 00:35:09 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:10 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 1073741824" returned: 0 in 1.155s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:10 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 Jul 10 00:35:10 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:11 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" returned: 0 in 0.664s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:35:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7f854e-f26f-4b37-acd2-b47cf7fb2264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b9305e-6784-4629-a2df-a17aefefb1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:11 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Volume volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 (2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4): created successfully Jul 10 00:35:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b9305e-6784-4629-a2df-a17aefefb1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Flow 'volume_create_manager' (9966ed0f-aa60-4c25-93c3-5eb691e786ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3cc2a194-a19f-420d-a065-e75762b07d09 tempest-VolumesDeleteCascade-1046606080 None] Created volume successfully. Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Creating offline snapshot 69bac350-0c79-47b2-9022-af17f069cd60 of volume 2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da7b8d-bfb3-43e5-b903-6ac1a850fe09]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:13 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 Jul 10 00:35:13 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-65a48929-72c0-42cd-b00a-67a3c905bd46 req-02acf983-05ad-481f-bfbc-e7e303ddd8ef tempest-ServerActionsTestOtherA-2007018710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:13 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" returned: 0 in 0.871s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:13 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 1G Jul 10 00:35:13 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:14 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 1G" returned: 0 in 0.930s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:14 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 Jul 10 00:35:14 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:15 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60" returned: 0 in 0.762s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:15 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 is being set with open permissions: ugo+rw Jul 10 00:35:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:15 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 Jul 10 00:35:15 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:16 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60" returned: 0 in 0.772s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:16 devstack sudo[91723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.info Jul 10 00:35:16 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:17 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.info" returned: 0 in 0.742s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:17 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.info is being set with open permissions: ugo+rw Jul 10 00:35:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:17 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.info Jul 10 00:35:17 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:17 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.info" returned: 0 in 0.740s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.937s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-65a48929-72c0-42cd-b00a-67a3c905bd46 req-02acf983-05ad-481f-bfbc-e7e303ddd8ef tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.286s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bab0294-8888-4d02-b136-bc2f2d73a50d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-65a48929-72c0-42cd-b00a-67a3c905bd46 req-02acf983-05ad-481f-bfbc-e7e303ddd8ef tempest-ServerActionsTestOtherA-2007018710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:18 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2f122064-c53f-49b9-9461-4ef5d72fa929 tempest-VolumesDeleteCascade-1046606080 None] Create snapshot completed successfully Jul 10 00:35:18 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 Jul 10 00:35:18 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:19 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-65a48929-72c0-42cd-b00a-67a3c905bd46 req-02acf983-05ad-481f-bfbc-e7e303ddd8ef tempest-ServerActionsTestOtherA-2007018710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13" returned: 0 in 1.159s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-65a48929-72c0-42cd-b00a-67a3c905bd46 req-02acf983-05ad-481f-bfbc-e7e303ddd8ef tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.188s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Flow 'volume_create_manager' (0cdba184-ac4a-4347-a5ac-58a8d32dd244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5be403-38ac-4fe8-b1b0-4f47871f2ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-65a48929-72c0-42cd-b00a-67a3c905bd46 req-02acf983-05ad-481f-bfbc-e7e303ddd8ef tempest-ServerActionsTestOtherA-2007018710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-c4503a08-0ce9-44a1-82bb-3038556eca13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7b9eda5-1316-4998-8dea-6307d187321f', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5be403-38ac-4fe8-b1b0-4f47871f2ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2084223337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f40fba2-6c8b-4dfe-be35-676c3e978f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4b10f583964c18b61642d0d52c716b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69bac350-0c79-47b2-9022-af17f069cd60,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:19Z,use_quota=True,user_id='d0ecc2bb26074578b791a16fb40ed088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4e7fef-f32f-44b1-b0a8-589a21bd7206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4e7fef-f32f-44b1-b0a8-589a21bd7206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936e0e31-ecb9-4b38-86ca-ff975a6aae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936e0e31-ecb9-4b38-86ca-ff975a6aae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f40fba2-6c8b-4dfe-be35-676c3e978f30', 'volume_name': 'volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30', 'volume_size': 1, 'snapshot_id': '69bac350-0c79-47b2-9022-af17f069cd60'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce45190d-d21f-4945-9bf1-92cd0e2231cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce45190d-d21f-4945-9bf1-92cd0e2231cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d016d4-cba1-4a6f-b33f-14db60540e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Volume 7f40fba2-6c8b-4dfe-be35-676c3e978f30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30', 'volume_size': 1, 'snapshot_id': '69bac350-0c79-47b2-9022-af17f069cd60'} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-69bac350-0c79-47b2-9022-af17f069cd60-7f40fba2-6c8b-4dfe-be35-676c3e978f30" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-69bac350-0c79-47b2-9022-af17f069cd60-7f40fba2-6c8b-4dfe-be35-676c3e978f30" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Creating volume 7f40fba2-6c8b-4dfe-be35-676c3e978f30 from snapshot 69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-7f40fba2-6c8b-4dfe-be35-676c3e978f30" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-7f40fba2-6c8b-4dfe-be35-676c3e978f30" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] snapshot: 69bac350-0c79-47b2-9022-af17f069cd60, volume: 7f40fba2-6c8b-4dfe-be35-676c3e978f30, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-65a48929-72c0-42cd-b00a-67a3c905bd46 req-02acf983-05ad-481f-bfbc-e7e303ddd8ef tempest-ServerActionsTestOtherA-2007018710 None] attachment_update completed successfully. Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[84671a90-9225-463e-9dcd-25e100937cd6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:19 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 Jul 10 00:35:19 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:20 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60" returned: 0 in 0.912s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:35:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:35:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:35:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[36970900-5c77-4dba-83fb-0a468eb92f99]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:20 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 Jul 10 00:35:20 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:21 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" returned: 0 in 1.080s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:21 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:35:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:21 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 Jul 10 00:35:21 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:27 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30" returned: 0 in 6.264s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c5f13-004f-42e7-9016-6f092ca0b1e5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:27 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 Jul 10 00:35:27 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:28 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" returned: 0 in 1.013s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:28 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:35:28 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Converted 1024.00 MB image at 163.44 MB/s Jul 10 00:35:28 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 is being set with open permissions: ugo+rw Jul 10 00:35:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:28 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 Jul 10 00:35:28 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=43,cinder:UPDATE=37,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=36,cinder:INSERT=10,cinder:DELETE=1,cinder:UPDATE=35 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:35:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-9001e477-52fa-49b0-9740-f74e8a50998d req-8acc4162-5019-43a7-9c7f-f8fd1c0cc7d9 tempest-ServerActionsTestOtherA-2007018710 None] Terminate volume connection completed successfully. Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-9001e477-52fa-49b0-9740-f74e8a50998d req-8acc4162-5019-43a7-9c7f-f8fd1c0cc7d9 tempest-ServerActionsTestOtherA-2007018710 None] Deleting attachment a7b9eda5-1316-4998-8dea-6307d187321f. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:35:29 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30" returned: 0 in 0.907s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-7f40fba2-6c8b-4dfe-be35-676c3e978f30" released by "_copy_volume_from_snapshot" :: held 10.308s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-69bac350-0c79-47b2-9022-af17f069cd60-7f40fba2-6c8b-4dfe-be35-676c3e978f30" released by "_create_volume_from_snapshot" :: held 10.361s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.383s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d016d4-cba1-4a6f-b33f-14db60540e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30', 'volume_size': 1, 'snapshot_id': '69bac350-0c79-47b2-9022-af17f069cd60'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68dd7518-f73b-4684-9672-af6879c7f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Volume volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 (7f40fba2-6c8b-4dfe-be35-676c3e978f30): created successfully Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68dd7518-f73b-4684-9672-af6879c7f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Flow 'volume_create_manager' (0cdba184-ac4a-4347-a5ac-58a8d32dd244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fb3ee1eb-d237-4319-90c2-ea29574d5e53 tempest-VolumesDeleteCascade-1046606080 None] Created volume successfully. Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Performing cascade delete. {{(pid=87452) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-69bac350-0c79-47b2-9022-af17f069cd60-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-69bac350-0c79-47b2-9022-af17f069cd60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-69bac350-0c79-47b2-9022-af17f069cd60" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-69bac350-0c79-47b2-9022-af17f069cd60" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Deleting offline snapshot 69bac350-0c79-47b2-9022-af17f069cd60 of volume 2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] snapshot_file for this snap is: volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe5dc5d-d4f1-430b-9793-d1fddd7369bb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:31 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 Jul 10 00:35:31 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:31 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60" returned: 0 in 1.038s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:35:31 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[113091a4-4f8a-4b4e-821e-970b0d1816f3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:32 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 Jul 10 00:35:32 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-9001e477-52fa-49b0-9740-f74e8a50998d req-2bf24196-fc2c-46c7-aa3a-2820d4bd324c tempest-ServerActionsTestOtherA-2007018710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-9001e477-52fa-49b0-9740-f74e8a50998d req-2bf24196-fc2c-46c7-aa3a-2820d4bd324c tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[20185f6d-c609-4937-bcd8-0178835c83ba]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-9001e477-52fa-49b0-9740-f74e8a50998d req-2bf24196-fc2c-46c7-aa3a-2820d4bd324c tempest-ServerActionsTestOtherA-2007018710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:32 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 Jul 10 00:35:32 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:32 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" returned: 0 in 0.825s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:32 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 Jul 10 00:35:32 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:33 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-9001e477-52fa-49b0-9740-f74e8a50998d req-2bf24196-fc2c-46c7-aa3a-2820d4bd324c tempest-ServerActionsTestOtherA-2007018710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13" returned: 0 in 0.921s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-9001e477-52fa-49b0-9740-f74e8a50998d req-2bf24196-fc2c-46c7-aa3a-2820d4bd324c tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.941s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-9001e477-52fa-49b0-9740-f74e8a50998d req-2bf24196-fc2c-46c7-aa3a-2820d4bd324c tempest-ServerActionsTestOtherA-2007018710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-c4503a08-0ce9-44a1-82bb-3038556eca13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae19b081-3e55-45f1-bc10-34d9260d1dcf', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:35:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-9001e477-52fa-49b0-9740-f74e8a50998d req-2bf24196-fc2c-46c7-aa3a-2820d4bd324c tempest-ServerActionsTestOtherA-2007018710 None] attachment_update completed successfully. Jul 10 00:35:34 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60" returned: 0 in 1.252s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:34 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60 Jul 10 00:35:34 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:34 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4.69bac350-0c79-47b2-9022-af17f069cd60" returned: 0 in 0.659s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-69bac350-0c79-47b2-9022-af17f069cd60" released by "_delete_snapshot" :: held 3.963s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" released by "delete_snapshot" :: held 3.995s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Created reservations ['c76b5f22-2f79-46e9-83f1-ce64d5e5ac56', '0eb4b142-b60d-4d6d-a804-11cd3db43e99', 'c681f134-a13d-47c3-b600-c0bc1428964a', '57e4e082-64be-4df2-83ff-a1fa0e6d4ff6'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Delete snapshot completed successfully. Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-69bac350-0c79-47b2-9022-af17f069cd60-delete_snapshot" released by "delete_snapshot" :: held 4.258s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Snapshots deleted, issuing volume delete {{(pid=87452) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ddd257-c279-428f-ae73-0eed2a9cd2b7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:35 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 Jul 10 00:35:35 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:36 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" returned: 0 in 1.349s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:36 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4 Jul 10 00:35:36 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:37 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" returned: 0 in 0.958s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4" released by "delete_volume" :: held 2.413s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Created reservations ['8538993f-ffde-43fa-932b-4e0cdfcd323b', 'a1323898-6914-4d0f-b67c-ebfbc81abc02', '4bd6602b-b6de-436a-a79f-ff43aacf0f51', 'dd6873a7-2307-4c2d-9ada-5b0ae9144bbe'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:37 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:35:37 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-7f40fba2-6c8b-4dfe-be35-676c3e978f30-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-7f40fba2-6c8b-4dfe-be35-676c3e978f30-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "cinder-quobyte-7f40fba2-6c8b-4dfe-be35-676c3e978f30" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-7f40fba2-6c8b-4dfe-be35-676c3e978f30" acquired by "delete_volume" :: waited 0.053s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:39 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[90debc6e-7cc3-457d-9152-856a51cb9d31]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:39 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.642s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:39 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:39 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Deleted volume successfully. Jul 10 00:35:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-522b39b7-5169-43c7-bedd-fbb14652ed94 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-2ae3e20b-6ff2-4bc1-85c5-bef7264e92d4-delete_volume" released by "delete_volume" :: held 8.781s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:39 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 Jul 10 00:35:39 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:40 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30" returned: 0 in 1.437s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:40 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30 Jul 10 00:35:40 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:41 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7f40fba2-6c8b-4dfe-be35-676c3e978f30" returned: 0 in 1.010s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-quobyte-7f40fba2-6c8b-4dfe-be35-676c3e978f30" released by "delete_volume" :: held 2.542s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Created reservations ['b71f3f95-12ec-4788-92fd-a600712fcd96', '59ab8f75-c407-40b0-a5be-6beb1dc63874', '2a74c118-62f9-4ac4-8a06-87ebe363ea23', '17ae172f-092f-490e-b048-4a8fbebaaf67'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:41 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:35:41 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:43 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.421s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:43 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:43 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Deleted volume successfully. Jul 10 00:35:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b79bb2c2-f55c-4fac-bc30-42b7fc66d995 tempest-VolumesDeleteCascade-1046606080 None] Lock "cinder-7f40fba2-6c8b-4dfe-be35-676c3e978f30-delete_volume" released by "delete_volume" :: held 4.467s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Flow 'volume_create_manager' (992cebe3-9705-4179-8db4-4abae15b8dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed6c12d-e396-4088-8f5c-e8c0f0a63c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed6c12d-e396-4088-8f5c-e8c0f0a63c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1219022249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1127ff804e41d4946d1f138be64fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:48Z,use_quota=True,user_id='14e4cacefd554c4585cab904bbb334c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06093125-3146-4f2f-a301-6b0e87c08e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06093125-3146-4f2f-a301-6b0e87c08e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637cc3f2-1635-4259-9838-8ffe93192cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637cc3f2-1635-4259-9838-8ffe93192cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce', 'volume_name': 'volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac8dd5f-a4ee-4ef4-b304-50bb56cf7afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac8dd5f-a4ee-4ef4-b304-50bb56cf7afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c298ef-46a9-4445-8a3f-d0f276f3418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Volume df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce', 'volume_size': 1} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1219022249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1127ff804e41d4946d1f138be64fcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:48Z,use_quota=True,user_id='14e4cacefd554c4585cab904bbb334c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Creating volume df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:48 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:35:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:48 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce 1073741824 Jul 10 00:35:48 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:49 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce 1073741824" returned: 0 in 0.900s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:49 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce Jul 10 00:35:49 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:50 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce" returned: 0 in 0.946s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:35:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c298ef-46a9-4445-8a3f-d0f276f3418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75c3b4f-2c37-4e04-bac4-8a72c169d0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:50 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Volume volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce (df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce): created successfully Jul 10 00:35:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75c3b4f-2c37-4e04-bac4-8a72c169d0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Flow 'volume_create_manager' (992cebe3-9705-4179-8db4-4abae15b8dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:50 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e67fa7a8-62b9-45af-9e2b-de72ab10787a tempest-VolumesMetadataTest-1275860351 None] Created volume successfully. Jul 10 00:35:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Acquiring lock "cinder-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Lock "cinder-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Acquiring lock "cinder-quobyte-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Lock "cinder-quobyte-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce" acquired by "delete_volume" :: waited 0.036s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82433e9-c579-40c5-a6e0-90da1af51811]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:52 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce Jul 10 00:35:52 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:53 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce" returned: 0 in 0.903s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:53 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce Jul 10 00:35:53 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:53 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:35:53 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:54 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce" returned: 0 in 0.953s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Lock "cinder-quobyte-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce" released by "delete_volume" :: held 1.928s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Created reservations ['9aaf70d7-0309-4a9b-9696-739fb5b93b1b', 'efdf3a46-3398-48b2-bd1c-900135a0b759', '9bff919d-5764-4377-87cf-679459087999', '2ff00cf1-8fe6-46e6-b1ca-6faf2f76943a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:54 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:35:54 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:55 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.513s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 8 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Flow 'volume_create_manager' (77b5788e-3107-4e14-82d3-686473aa94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178c74af-f560-4378-bae1-27682916e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178c74af-f560-4378-bae1-27682916e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-620298877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52112fa-eb38-44cd-9471-c1b419f54165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a722201ab9b94a259898dcf13177aea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:56Z,use_quota=True,user_id='d9d5846121ae40a49db1a77c36e7e072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc98de6-de11-467d-ba6f-cd9c841e0ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc98de6-de11-467d-ba6f-cd9c841e0ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0a1468-96ca-4d7c-a964-0ec90596eb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0a1468-96ca-4d7c-a964-0ec90596eb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52112fa-eb38-44cd-9471-c1b419f54165', 'volume_name': 'volume-b52112fa-eb38-44cd-9471-c1b419f54165', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fabd93-55fb-4813-a5ca-725ac29141f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fabd93-55fb-4813-a5ca-725ac29141f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e41c93-f380-49e4-9c79-4dc74a43ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Volume b52112fa-eb38-44cd-9471-c1b419f54165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52112fa-eb38-44cd-9471-c1b419f54165', 'volume_size': 1} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-620298877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52112fa-eb38-44cd-9471-c1b419f54165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a722201ab9b94a259898dcf13177aea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:56Z,use_quota=True,user_id='d9d5846121ae40a49db1a77c36e7e072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Creating volume b52112fa-eb38-44cd-9471-c1b419f54165 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:55 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:35:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:55 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 1073741824 Jul 10 00:35:55 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:56 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.626s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:56 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Deleted volume successfully. Jul 10 00:35:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-527c3552-e75e-4e18-8aec-4bc494635667 tempest-VolumesMetadataTest-1275860351 None] Lock "cinder-df4bf70c-2f07-4fdd-97a2-1a6aed4a48ce-delete_volume" released by "delete_volume" :: held 3.936s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:57 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 1073741824" returned: 0 in 1.320s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:57 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 Jul 10 00:35:57 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:58 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165" returned: 0 in 0.871s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:35:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.267s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e41c93-f380-49e4-9c79-4dc74a43ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52112fa-eb38-44cd-9471-c1b419f54165', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4048a3-b140-4108-8a04-0a14f6d63270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Volume volume-b52112fa-eb38-44cd-9471-c1b419f54165 (b52112fa-eb38-44cd-9471-c1b419f54165): created successfully Jul 10 00:35:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4048a3-b140-4108-8a04-0a14f6d63270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Flow 'volume_create_manager' (77b5788e-3107-4e14-82d3-686473aa94a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-48f78dc1-f538-43de-bd36-33af6028a920 tempest-ServerRescueNegativeTestJSON-474889634 None] Created volume successfully. Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Flow 'volume_create_manager' (1ee7af28-ae71-4c81-a36b-ddad3679d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e2b439-9cc9-417c-b1b7-0d43ae9dc35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e2b439-9cc9-417c-b1b7-0d43ae9dc35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1650980887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a067219-fc66-477a-a93d-096023c4c3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0340190e020d43ce83f38ebd63f95b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:02Z,use_quota=True,user_id='55f9f3b1ba104280b64797415cbc8fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5a730b-40b0-44fd-ac11-869710bcae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5a730b-40b0-44fd-ac11-869710bcae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d550d547-73dc-4121-88d3-489665d62319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d550d547-73dc-4121-88d3-489665d62319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a067219-fc66-477a-a93d-096023c4c3e1', 'volume_name': 'volume-6a067219-fc66-477a-a93d-096023c4c3e1', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9def70de-9900-4605-9182-dad123c94840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9def70de-9900-4605-9182-dad123c94840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e718b098-de4a-4740-aafc-2127a6224f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:01 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Volume 6a067219-fc66-477a-a93d-096023c4c3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a067219-fc66-477a-a93d-096023c4c3e1', 'volume_size': 1} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1650980887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a067219-fc66-477a-a93d-096023c4c3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0340190e020d43ce83f38ebd63f95b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:02Z,use_quota=True,user_id='55f9f3b1ba104280b64797415cbc8fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Creating volume 6a067219-fc66-477a-a93d-096023c4c3e1 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:36:01 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:36:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:01 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 1073741824 Jul 10 00:36:01 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:02 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 1073741824" returned: 0 in 0.968s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:02 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 Jul 10 00:36:02 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:03 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1" returned: 0 in 0.755s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:36:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e718b098-de4a-4740-aafc-2127a6224f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a067219-fc66-477a-a93d-096023c4c3e1', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e923f80-684f-40b3-be8c-346047b4a387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Volume volume-6a067219-fc66-477a-a93d-096023c4c3e1 (6a067219-fc66-477a-a93d-096023c4c3e1): created successfully Jul 10 00:36:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e923f80-684f-40b3-be8c-346047b4a387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Flow 'volume_create_manager' (1ee7af28-ae71-4c81-a36b-ddad3679d79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-785e3047-92a5-4603-b231-3280152be34e tempest-VolumesTransfersV355Test-492388042 None] Created volume successfully. Jul 10 00:36:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-001fb505-2880-4ca7-99fb-672dd7991e4e tempest-VolumesTransfersV355Test-255237639 None] Transfer volume completed successfully. Jul 10 00:36:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Acquiring lock "cinder-6a067219-fc66-477a-a93d-096023c4c3e1-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-6a067219-fc66-477a-a93d-096023c4c3e1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Acquiring lock "cinder-quobyte-6a067219-fc66-477a-a93d-096023c4c3e1" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-quobyte-6a067219-fc66-477a-a93d-096023c4c3e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fdfa00-4406-4bfd-ad16-840a19c8664b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:06 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 Jul 10 00:36:06 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:06 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1" returned: 0 in 0.880s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:06 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1 Jul 10 00:36:06 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:07 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6a067219-fc66-477a-a93d-096023c4c3e1" returned: 0 in 0.681s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-quobyte-6a067219-fc66-477a-a93d-096023c4c3e1" released by "delete_volume" :: held 1.613s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Created reservations ['8111af6b-a5d3-4a63-a775-e24bcf81269e', '31208562-0605-4f7d-88b8-e9690a451831', 'd89a0fc9-4230-48c2-bc22-38de0e132363', 'ad080724-06b6-434b-bbb8-9805636be667'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:07 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:36:07 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:08 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.707s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Deleted volume successfully. Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-14151a3e-311a-43d0-bdab-c52afe56686f tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-6a067219-fc66-477a-a93d-096023c4c3e1-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Flow 'volume_create_manager' (44d4029b-c040-4bce-857e-5d1b710ac2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c04eb6a-51bd-4fe4-a9a5-7f613f4035fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c04eb6a-51bd-4fe4-a9a5-7f613f4035fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-249109402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79119e9-0a5c-45c3-814f-716b2f86cd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0340190e020d43ce83f38ebd63f95b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:09Z,use_quota=True,user_id='55f9f3b1ba104280b64797415cbc8fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54139ba8-4aeb-4ffe-bf42-9e7b3aef5daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54139ba8-4aeb-4ffe-bf42-9e7b3aef5daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d80b187-e912-4a7e-9672-e296e0caabe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d80b187-e912-4a7e-9672-e296e0caabe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd79119e9-0a5c-45c3-814f-716b2f86cd6e', 'volume_name': 'volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c724636b-0c17-45fe-80c5-6aaedffc1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c724636b-0c17-45fe-80c5-6aaedffc1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a327ce-6760-4a2e-9636-274e28acd4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:08 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Volume d79119e9-0a5c-45c3-814f-716b2f86cd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e', 'volume_size': 1} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-249109402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79119e9-0a5c-45c3-814f-716b2f86cd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0340190e020d43ce83f38ebd63f95b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:09Z,use_quota=True,user_id='55f9f3b1ba104280b64797415cbc8fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Creating volume d79119e9-0a5c-45c3-814f-716b2f86cd6e {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:36:08 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:36:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:08 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e 1073741824 Jul 10 00:36:08 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:09 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e 1073741824" returned: 0 in 0.997s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:10 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e Jul 10 00:36:10 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:10 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e" returned: 0 in 0.763s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:36:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a327ce-6760-4a2e-9636-274e28acd4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de8ee3c-dd89-4721-9931-20f2c1c9d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:10 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Volume volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e (d79119e9-0a5c-45c3-814f-716b2f86cd6e): created successfully Jul 10 00:36:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de8ee3c-dd89-4721-9931-20f2c1c9d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Flow 'volume_create_manager' (44d4029b-c040-4bce-857e-5d1b710ac2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-703cee2d-c8d4-417c-9412-82018dcb6874 tempest-VolumesTransfersV355Test-492388042 None] Created volume successfully. Jul 10 00:36:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Acquiring lock "cinder-d79119e9-0a5c-45c3-814f-716b2f86cd6e-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-d79119e9-0a5c-45c3-814f-716b2f86cd6e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Acquiring lock "cinder-quobyte-d79119e9-0a5c-45c3-814f-716b2f86cd6e" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-quobyte-d79119e9-0a5c-45c3-814f-716b2f86cd6e" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:11 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d54c26a-cf91-4a39-8337-0d40ff5997dd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:11 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e Jul 10 00:36:11 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-c75fb859-b170-4cb2-a193-dd22a6df1b26 req-09fc3088-b843-4206-96cb-e5c00a54cacf tempest-ServerActionsTestOtherA-2007018710 None] Terminate volume connection completed successfully. Jul 10 00:36:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-c75fb859-b170-4cb2-a193-dd22a6df1b26 req-09fc3088-b843-4206-96cb-e5c00a54cacf tempest-ServerActionsTestOtherA-2007018710 None] Deleting attachment ae19b081-3e55-45f1-bc10-34d9260d1dcf. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:36:12 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e" returned: 0 in 1.156s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:12 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e Jul 10 00:36:12 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:13 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d79119e9-0a5c-45c3-814f-716b2f86cd6e" returned: 0 in 0.717s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-quobyte-d79119e9-0a5c-45c3-814f-716b2f86cd6e" released by "delete_volume" :: held 1.923s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Created reservations ['17d15879-8aa8-477c-a6cb-801c81bc01ad', '7ba7020b-e325-4f79-b765-68ad248b47cb', '2e470478-d3bd-40ce-abef-16abf9e9aa23', '3d369bf6-f1ad-4729-86b3-7f700e13e4c4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:13 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:36:13 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:14 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.902s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:14 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Deleted volume successfully. Jul 10 00:36:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7fb440b4-f0bd-4548-a995-62b3047649b7 tempest-VolumesTransfersV355Test-1150346319 None] Lock "cinder-d79119e9-0a5c-45c3-814f-716b2f86cd6e-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Acquiring lock "cinder-b52112fa-eb38-44cd-9471-c1b419f54165-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "cinder-b52112fa-eb38-44cd-9471-c1b419f54165-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Acquiring lock "cinder-quobyte-b52112fa-eb38-44cd-9471-c1b419f54165" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "cinder-quobyte-b52112fa-eb38-44cd-9471-c1b419f54165" acquired by "delete_volume" :: waited 0.050s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a7658-21e9-454b-9494-bfef1825f36f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:18 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 Jul 10 00:36:18 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:19 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165" returned: 0 in 1.289s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:19 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165 Jul 10 00:36:19 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:20 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b52112fa-eb38-44cd-9471-c1b419f54165" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "cinder-quobyte-b52112fa-eb38-44cd-9471-c1b419f54165" released by "delete_volume" :: held 2.123s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Created reservations ['c0b525af-1f81-4aa5-9e91-08f3f3ca9b15', '8faf66af-253b-44fc-9ddc-9c3312437096', 'b059835c-f8e4-4385-b677-fa0c5ab3aaf0', 'e2fcda59-117a-45b1-a7f6-52ff543c145c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:20 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:36:20 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:21 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.773s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:21 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Deleted volume successfully. Jul 10 00:36:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ec403bc0-c920-40d4-9b63-aff361c0b60a tempest-ServerRescueNegativeTestJSON-474889634 None] Lock "cinder-b52112fa-eb38-44cd-9471-c1b419f54165-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Flow 'volume_create_manager' (33878a64-c549-495b-b7cb-ba143ad3ca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76239d3a-49f1-4bd5-92cc-a873038bb2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76239d3a-49f1-4bd5-92cc-a873038bb2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1894352553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90604889-424a-4cdc-a28f-ef6a6c90f197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfc3a82d039487daf18c5610426cc17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:23Z,use_quota=True,user_id='715a2300d9334c37bc359d91aa60d3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000925bf-88cd-4126-b5b6-bf7d0e00b297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000925bf-88cd-4126-b5b6-bf7d0e00b297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b7d37-1472-482f-bd22-a79ac250f7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b7d37-1472-482f-bd22-a79ac250f7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90604889-424a-4cdc-a28f-ef6a6c90f197', 'volume_name': 'volume-90604889-424a-4cdc-a28f-ef6a6c90f197', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe26533-d612-4a98-8147-ae5a85f083d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe26533-d612-4a98-8147-ae5a85f083d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2617e3-7419-41a5-9e42-0021d62757b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:22 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Volume 90604889-424a-4cdc-a28f-ef6a6c90f197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90604889-424a-4cdc-a28f-ef6a6c90f197', 'volume_size': 1} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1894352553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90604889-424a-4cdc-a28f-ef6a6c90f197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfc3a82d039487daf18c5610426cc17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:23Z,use_quota=True,user_id='715a2300d9334c37bc359d91aa60d3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Creating volume 90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:36:22 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:36:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:22 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 1073741824 Jul 10 00:36:22 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:23 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 1073741824" returned: 0 in 1.257s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:24 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 Jul 10 00:36:24 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Acquiring lock "cinder-c4503a08-0ce9-44a1-82bb-3038556eca13-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Lock "cinder-c4503a08-0ce9-44a1-82bb-3038556eca13-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Acquiring lock "cinder-quobyte-c4503a08-0ce9-44a1-82bb-3038556eca13" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Lock "cinder-quobyte-c4503a08-0ce9-44a1-82bb-3038556eca13" acquired by "delete_volume" :: waited 0.036s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dab46c2-a1b8-4a9f-b866-e8310fcaa3fe]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:24 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 Jul 10 00:36:24 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:25 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197" returned: 0 in 1.624s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] <== create_volume: return (3021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.024s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2617e3-7419-41a5-9e42-0021d62757b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90604889-424a-4cdc-a28f-ef6a6c90f197', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f388c5-c2b6-4f18-b2cc-7b13106775f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:25 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Volume volume-90604889-424a-4cdc-a28f-ef6a6c90f197 (90604889-424a-4cdc-a28f-ef6a6c90f197): created successfully Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f388c5-c2b6-4f18-b2cc-7b13106775f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Flow 'volume_create_manager' (33878a64-c549-495b-b7cb-ba143ad3ca88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-05232b96-607d-46ce-b801-aed9b8e68c0d tempest-VolumesSnapshotListTestJSON-1854420341 None] Created volume successfully. Jul 10 00:36:25 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13" returned: 0 in 1.466s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:25 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13 Jul 10 00:36:25 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:26 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4503a08-0ce9-44a1-82bb-3038556eca13" returned: 0 in 0.684s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Lock "cinder-quobyte-c4503a08-0ce9-44a1-82bb-3038556eca13" released by "delete_volume" :: held 2.237s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Created reservations ['743a4ef9-7dca-4d9f-b97d-b155aaa76921', 'c8d5b4f8-685c-49c7-ab25-4e324fa8b101', '85236542-8ed4-426b-a36b-bf1bea05c85a', '67cc5c81-452d-45cc-8296-777e929a4b2a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:26 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:36:26 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Creating offline snapshot 220690ed-5b4e-4034-9f5e-59f0ba8e935d of volume 90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a9780e-504f-4941-ad2e-1e086e1657ac]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:27 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 Jul 10 00:36:27 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:27 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.007s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Deleted volume successfully. Jul 10 00:36:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7ce9d185-cc0a-4043-b17d-722b52db9123 tempest-ServerActionsTestOtherA-2007018710 None] Lock "cinder-c4503a08-0ce9-44a1-82bb-3038556eca13-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:28 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197" returned: 0 in 1.066s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:28 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d 1G Jul 10 00:36:28 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:29 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d 1G" returned: 0 in 0.813s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:29 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d Jul 10 00:36:29 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:30 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d" returned: 0 in 0.925s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:30 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d is being set with open permissions: ugo+rw Jul 10 00:36:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:30 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d Jul 10 00:36:30 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:31 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d" returned: 0 in 0.804s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:31 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=65,cinder:UPDATE=81,cinder:DELETE=5,cinder:INSERT=20 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:36:31 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=57,cinder:UPDATE=79,cinder:INSERT=17,cinder:DELETE=8 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:36:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:31 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.info Jul 10 00:36:31 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:31 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.info" returned: 0 in 0.791s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:31 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.info is being set with open permissions: ugo+rw Jul 10 00:36:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:31 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.info Jul 10 00:36:31 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:32 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.info" returned: 0 in 0.631s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.159s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a70c36c6-e7f9-4083-ab9d-23eb1dc5d6b5 tempest-VolumesSnapshotListTestJSON-1854420341 None] Create snapshot completed successfully Jul 10 00:36:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Creating offline snapshot c9a3c267-59df-4f32-aa6b-0d5b92a06787 of volume 90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:36:33 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe664b03-92c2-47ca-9a06-670bfababcfc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:34 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d Jul 10 00:36:34 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:34 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d" returned: 0 in 0.843s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90604889-424a-4cdc-a28f-ef6a6c90f197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:36:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:34 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 1G Jul 10 00:36:34 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:35 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 1G" returned: 0 in 0.877s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:35 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 Jul 10 00:36:35 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:36 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787" returned: 0 in 0.792s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:36 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 is being set with open permissions: ugo+rw Jul 10 00:36:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:36 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 Jul 10 00:36:36 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:37 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787" returned: 0 in 0.635s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.310s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8e5aef2f-bfac-495e-a72c-b8733aed2892 tempest-VolumesSnapshotListTestJSON-1854420341 None] Create snapshot completed successfully Jul 10 00:36:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Creating offline snapshot d3b297bb-705d-4d30-9ee7-af468cd6fe83 of volume 90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:36:38 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2a32d7-0fa5-4ceb-a244-94623b49fc8a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:38 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 Jul 10 00:36:38 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:39 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787" returned: 0 in 0.998s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90604889-424a-4cdc-a28f-ef6a6c90f197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:36:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:39 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 1G Jul 10 00:36:39 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:40 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 1G" returned: 0 in 1.124s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:40 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 Jul 10 00:36:40 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:41 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83" returned: 0 in 0.977s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:41 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 is being set with open permissions: ugo+rw Jul 10 00:36:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:41 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 Jul 10 00:36:41 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:42 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83" returned: 0 in 0.824s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.076s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:42 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ea7c3e6f-2f4a-474e-bbd6-9e7d15d9c344 tempest-VolumesSnapshotListTestJSON-1854420341 None] Create snapshot completed successfully Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-d3b297bb-705d-4d30-9ee7-af468cd6fe83-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-d3b297bb-705d-4d30-9ee7-af468cd6fe83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-quobyte-d3b297bb-705d-4d30-9ee7-af468cd6fe83" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-d3b297bb-705d-4d30-9ee7-af468cd6fe83" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Deleting offline snapshot d3b297bb-705d-4d30-9ee7-af468cd6fe83 of volume 90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] snapshot_file for this snap is: volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb11972-4922-4510-850c-3352f52aee17]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:43 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 Jul 10 00:36:43 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:44 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83" returned: 0 in 0.900s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90604889-424a-4cdc-a28f-ef6a6c90f197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:36:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11bbb37-43c2-4b31-8663-7e74bd887dc7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:44 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 Jul 10 00:36:44 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:45 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787" returned: 0 in 0.923s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90604889-424a-4cdc-a28f-ef6a6c90f197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:36:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:45 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 Jul 10 00:36:45 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:46 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83" returned: 0 in 1.035s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:46 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83 Jul 10 00:36:46 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:47 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.d3b297bb-705d-4d30-9ee7-af468cd6fe83" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-d3b297bb-705d-4d30-9ee7-af468cd6fe83" released by "_delete_snapshot" :: held 3.685s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" released by "delete_snapshot" :: held 3.713s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Created reservations ['edcef654-5b50-43b1-a049-4e0eea74a1e9', '53ae928b-5baa-40da-99aa-2e52ecf7a072', '4a6aab54-c8c0-4e14-9cd0-fa15e8ed29ba', '5d96ef82-2afb-4db3-b5b4-2758e80ec82a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Delete snapshot completed successfully. Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-111040cb-6801-462d-bd9f-d938161e5c99 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-d3b297bb-705d-4d30-9ee7-af468cd6fe83-delete_snapshot" released by "delete_snapshot" :: held 3.901s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-c9a3c267-59df-4f32-aa6b-0d5b92a06787-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-c9a3c267-59df-4f32-aa6b-0d5b92a06787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-quobyte-c9a3c267-59df-4f32-aa6b-0d5b92a06787" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-c9a3c267-59df-4f32-aa6b-0d5b92a06787" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Deleting offline snapshot c9a3c267-59df-4f32-aa6b-0d5b92a06787 of volume 90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] snapshot_file for this snap is: volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e3913a-2df7-4af7-aeae-332f96464f93]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:47 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 Jul 10 00:36:47 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:48 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787" returned: 0 in 0.959s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90604889-424a-4cdc-a28f-ef6a6c90f197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:36:48 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[84330735-3741-4d1c-ba2a-d0a27f74a57f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:48 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d Jul 10 00:36:48 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:49 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d" returned: 0 in 1.042s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:49 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90604889-424a-4cdc-a28f-ef6a6c90f197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:36:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:49 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 Jul 10 00:36:49 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:50 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787" returned: 0 in 0.977s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:50 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787 Jul 10 00:36:50 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:51 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.c9a3c267-59df-4f32-aa6b-0d5b92a06787" returned: 0 in 0.866s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-c9a3c267-59df-4f32-aa6b-0d5b92a06787" released by "_delete_snapshot" :: held 4.002s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" released by "delete_snapshot" :: held 4.043s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:51 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Created reservations ['e975cb39-e482-4070-913f-71d261f2ad1c', 'e5b6138b-ec33-4871-8e75-020fb62e8284', 'f8c3bbc1-d2f7-4257-a5e1-f64de4d920fc', 'c50d6b76-466f-4d60-b80d-f1cf69430418'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Delete snapshot completed successfully. Jul 10 00:36:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2f171ebc-97e8-4430-9460-1524fa748625 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-c9a3c267-59df-4f32-aa6b-0d5b92a06787-delete_snapshot" released by "delete_snapshot" :: held 4.302s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-220690ed-5b4e-4034-9f5e-59f0ba8e935d-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-220690ed-5b4e-4034-9f5e-59f0ba8e935d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-quobyte-220690ed-5b4e-4034-9f5e-59f0ba8e935d" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-220690ed-5b4e-4034-9f5e-59f0ba8e935d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Deleting offline snapshot 220690ed-5b4e-4034-9f5e-59f0ba8e935d of volume 90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] snapshot_file for this snap is: volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3192cfca-0262-48ad-971c-8b89f3fef9a4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:53 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d Jul 10 00:36:53 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:53 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:36:53 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:54 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d" returned: 0 in 0.913s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90604889-424a-4cdc-a28f-ef6a6c90f197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[932dad30-3dbb-4235-9f7e-534cde8f4476]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:54 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 Jul 10 00:36:54 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:54 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.811s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 8 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:36:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:36:55 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197" returned: 0 in 1.203s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:55 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d Jul 10 00:36:55 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:56 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d" returned: 0 in 0.903s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:56 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d Jul 10 00:36:56 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:57 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197.220690ed-5b4e-4034-9f5e-59f0ba8e935d" returned: 0 in 0.812s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-220690ed-5b4e-4034-9f5e-59f0ba8e935d" released by "_delete_snapshot" :: held 3.999s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" released by "delete_snapshot" :: held 4.028s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Created reservations ['b7e61f97-4506-4e26-9e40-512dd23a4456', '6653c1eb-8508-40b4-a695-6441233e136a', '155273d5-dab4-4de7-bcef-d1cd277f9914', '6b56958d-44b7-4b79-84e5-5496d4edec33'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-166c571c-5116-49b1-8fca-0ac001e070b7 tempest-GroupsTest-578649179 None] Group tempest-Group1-192131434: creating Jul 10 00:36:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-166c571c-5116-49b1-8fca-0ac001e070b7 tempest-GroupsTest-578649179 None] Group tempest-Group1-192131434: created successfully Jul 10 00:36:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-166c571c-5116-49b1-8fca-0ac001e070b7 tempest-GroupsTest-578649179 None] Create group completed successfully. Jul 10 00:36:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Delete snapshot completed successfully. Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fe12a99b-854c-41de-89a6-de7d0132eb38 tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-220690ed-5b4e-4034-9f5e-59f0ba8e935d-delete_snapshot" released by "delete_snapshot" :: held 4.283s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-90604889-424a-4cdc-a28f-ef6a6c90f197-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-90604889-424a-4cdc-a28f-ef6a6c90f197-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bad481-0a0c-4a3e-8e43-ec432caccb9b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:57 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 Jul 10 00:36:57 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ef763010-1725-456a-bce3-c216393d7501 tempest-GroupsTest-578649179 None] Group tempest-Group2-21343151: creating Jul 10 00:36:58 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197" returned: 0 in 0.932s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:58 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197 Jul 10 00:36:58 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ef763010-1725-456a-bce3-c216393d7501 tempest-GroupsTest-578649179 None] Group tempest-Group2-21343151: created successfully Jul 10 00:36:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ef763010-1725-456a-bce3-c216393d7501 tempest-GroupsTest-578649179 None] Create group completed successfully. Jul 10 00:36:59 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-90604889-424a-4cdc-a28f-ef6a6c90f197" returned: 0 in 0.689s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-quobyte-90604889-424a-4cdc-a28f-ef6a6c90f197" released by "delete_volume" :: held 1.705s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Created reservations ['e4547a76-4434-487e-9657-1eb26ed2d148', '64f90d8c-5aeb-45bd-bf41-625d04f628fb', 'ff26538a-36aa-46e6-8ae8-78d38091eb94', '46f5b94e-7c21-4374-bf4f-7356ebc16b1d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:59 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:36:59 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:00 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.800s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Deleted volume successfully. Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1b4decff-3a28-467c-b3ef-dce33af938ae tempest-VolumesSnapshotListTestJSON-1854420341 None] Lock "cinder-90604889-424a-4cdc-a28f-ef6a6c90f197-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Flow 'volume_create_manager' (d98843e5-4434-46b5-af49-6aa43c3601d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225c40d0-bb89-43d2-b677-1e19e92e81c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225c40d0-bb89-43d2-b677-1e19e92e81c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-412610486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=510789d7-5136-4b21-a2a9-fcf0c2fe60cb,host='devstack@QuobyteHD#QuobyteHD',id=807c4f9c-0c26-4b57-be76-d99abc511fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0569a6d6a4c16bf2d862cb390cca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:00Z,use_quota=True,user_id='83fd00ed17224d0fac71144a649c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1883178-c702-4653-aee5-45466ab7057c),volume_type_id=c1883178-c702-4653-aee5-45466ab7057c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a19bb4e-c638-47de-b1c9-aa4bae831053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a19bb4e-c638-47de-b1c9-aa4bae831053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e36fcca-d19c-429a-b9a1-225cd181bab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e36fcca-d19c-429a-b9a1-225cd181bab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807c4f9c-0c26-4b57-be76-d99abc511fa2', 'volume_name': 'volume-807c4f9c-0c26-4b57-be76-d99abc511fa2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109aed50-a7f8-4cfe-88fe-160266a51a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109aed50-a7f8-4cfe-88fe-160266a51a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6651a5b-310d-45d3-a6c9-03b24b988d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Volume 807c4f9c-0c26-4b57-be76-d99abc511fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807c4f9c-0c26-4b57-be76-d99abc511fa2', 'volume_size': 1} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=510789d7-5136-4b21-a2a9-fcf0c2fe60cb,created_at=2026-07-09T22:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-412610486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=510789d7-5136-4b21-a2a9-fcf0c2fe60cb,host='devstack@QuobyteHD#QuobyteHD',id=807c4f9c-0c26-4b57-be76-d99abc511fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0569a6d6a4c16bf2d862cb390cca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:00Z,use_quota=True,user_id='83fd00ed17224d0fac71144a649c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1883178-c702-4653-aee5-45466ab7057c),volume_type_id=c1883178-c702-4653-aee5-45466ab7057c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Creating volume 807c4f9c-0c26-4b57-be76-d99abc511fa2 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:00 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:37:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:00 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 1073741824 Jul 10 00:37:00 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:01 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 1073741824" returned: 0 in 1.004s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:01 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 Jul 10 00:37:01 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:02 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2" returned: 0 in 0.707s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6651a5b-310d-45d3-a6c9-03b24b988d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807c4f9c-0c26-4b57-be76-d99abc511fa2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a80fae7-bab7-4836-a1c4-899ccdf9e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:02 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Volume volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 (807c4f9c-0c26-4b57-be76-d99abc511fa2): created successfully Jul 10 00:37:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a80fae7-bab7-4836-a1c4-899ccdf9e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Flow 'volume_create_manager' (d98843e5-4434-46b5-af49-6aa43c3601d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-177cbdf9-db9f-4bd3-86e5-8fb62ce60f7d tempest-GroupsTest-578649179 None] Created volume successfully. Jul 10 00:37:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Acquiring lock "cinder-quobyte-807c4f9c-0c26-4b57-be76-d99abc511fa2" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Lock "cinder-quobyte-807c4f9c-0c26-4b57-be76-d99abc511fa2" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23216a7-f62f-4066-a760-29ea8cc001ce]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:03 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 Jul 10 00:37:03 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:04 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2" returned: 0 in 0.776s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:04 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2 Jul 10 00:37:04 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:04 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-807c4f9c-0c26-4b57-be76-d99abc511fa2" returned: 0 in 0.679s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Lock "cinder-quobyte-807c4f9c-0c26-4b57-be76-d99abc511fa2" released by "delete_volume" :: held 1.521s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Created reservations ['1558288f-1284-4779-85d7-cd275f3d13e6'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:05 devstack cinder-volume[87452]: WARNING cinder.quota [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1244025199 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1244025199, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:05 devstack cinder-volume[87452]: WARNING cinder.quota [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1244025199 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1244025199, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Created reservations ['ceac1ec6-aef2-46c4-b1c8-627621109825', '2bd8a73f-cb9a-4ec0-9602-904e53e0f94f', '6f53725c-662e-4706-9a18-55653fbcf4e3', 'e82e5272-7359-46ae-a860-7999f57802f4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:05 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:37:05 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:06 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.829s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-73dd7fc4-5347-4e3a-a9b7-49ae2214ef97 tempest-GroupsTest-578649179 None] Delete group completed successfully. Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Created reservations ['7c6e1525-5587-42e5-8851-e348306dcbc6'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:06 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:37:06 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:07 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.789s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:07 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-69637c14-b887-41b6-aedc-500034045166 tempest-GroupsTest-578649179 None] Delete group completed successfully. Jul 10 00:37:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2c6b3e94-209b-41ae-99f1-4e381fc0150a tempest-GroupsTest-578649179 None] Group tempest-GroupsTest-Group-1991712416: creating Jul 10 00:37:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2c6b3e94-209b-41ae-99f1-4e381fc0150a tempest-GroupsTest-578649179 None] Group tempest-GroupsTest-Group-1991712416: created successfully Jul 10 00:37:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2c6b3e94-209b-41ae-99f1-4e381fc0150a tempest-GroupsTest-578649179 None] Create group completed successfully. Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Flow 'volume_create_manager' (b131803b-5419-4787-87f3-ca79e8d9f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5be2e7b-2def-4978-a3c2-5ce79ca87acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5be2e7b-2def-4978-a3c2-5ce79ca87acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-69841717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f7ee863-dfa9-4b4e-8c3a-0aaef02ac912,host='devstack@QuobyteHD#QuobyteHD',id=72922c6d-4752-4042-88c8-e2bdde648ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0569a6d6a4c16bf2d862cb390cca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:09Z,use_quota=True,user_id='83fd00ed17224d0fac71144a649c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b16bb022-8ce7-4203-a1d3-b560bed8fc5a),volume_type_id=b16bb022-8ce7-4203-a1d3-b560bed8fc5a)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56753ce4-5834-4f6c-b602-3d731e453751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56753ce4-5834-4f6c-b602-3d731e453751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58513f24-71aa-4ae4-a3f5-d41f2363f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58513f24-71aa-4ae4-a3f5-d41f2363f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72922c6d-4752-4042-88c8-e2bdde648ca8', 'volume_name': 'volume-72922c6d-4752-4042-88c8-e2bdde648ca8', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1647e4fd-835f-4c57-a390-8981dc1f9480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1647e4fd-835f-4c57-a390-8981dc1f9480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf64d71-a816-4ae8-8932-9b2deba2a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:09 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Volume 72922c6d-4752-4042-88c8-e2bdde648ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72922c6d-4752-4042-88c8-e2bdde648ca8', 'volume_size': 1} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f7ee863-dfa9-4b4e-8c3a-0aaef02ac912,created_at=2026-07-09T22:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-69841717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f7ee863-dfa9-4b4e-8c3a-0aaef02ac912,host='devstack@QuobyteHD#QuobyteHD',id=72922c6d-4752-4042-88c8-e2bdde648ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0569a6d6a4c16bf2d862cb390cca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:09Z,use_quota=True,user_id='83fd00ed17224d0fac71144a649c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b16bb022-8ce7-4203-a1d3-b560bed8fc5a),volume_type_id=b16bb022-8ce7-4203-a1d3-b560bed8fc5a)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Creating volume 72922c6d-4752-4042-88c8-e2bdde648ca8 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:09 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:37:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:09 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 1073741824 Jul 10 00:37:09 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:10 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 1073741824" returned: 0 in 1.113s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:10 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 Jul 10 00:37:10 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:12 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8" returned: 0 in 1.183s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.348s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf64d71-a816-4ae8-8932-9b2deba2a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72922c6d-4752-4042-88c8-e2bdde648ca8', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7594fc3c-6be5-4b90-ae71-2d6b097decc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Volume volume-72922c6d-4752-4042-88c8-e2bdde648ca8 (72922c6d-4752-4042-88c8-e2bdde648ca8): created successfully Jul 10 00:37:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7594fc3c-6be5-4b90-ae71-2d6b097decc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Flow 'volume_create_manager' (b131803b-5419-4787-87f3-ca79e8d9f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8bc3283a-1cc8-43f0-ab67-9a0703f8d29f tempest-GroupsTest-578649179 None] Created volume successfully. Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Flow 'volume_create_manager' (8e26dcea-7bb6-4d42-b85d-ddc708adf11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72aaf64-2d03-46f4-a586-5ec5a43b3ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72aaf64-2d03-46f4-a586-5ec5a43b3ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-345480961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f7ee863-dfa9-4b4e-8c3a-0aaef02ac912,host='devstack@QuobyteHD#QuobyteHD',id=cdafce88-b19f-4c55-9976-d032f956472f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0569a6d6a4c16bf2d862cb390cca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:14Z,use_quota=True,user_id='83fd00ed17224d0fac71144a649c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b16bb022-8ce7-4203-a1d3-b560bed8fc5a),volume_type_id=b16bb022-8ce7-4203-a1d3-b560bed8fc5a)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5204df14-65ce-44e7-8fa5-f23e2fe6e586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5204df14-65ce-44e7-8fa5-f23e2fe6e586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca80d24-88d5-411e-a36b-badda75d91a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca80d24-88d5-411e-a36b-badda75d91a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdafce88-b19f-4c55-9976-d032f956472f', 'volume_name': 'volume-cdafce88-b19f-4c55-9976-d032f956472f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f50470f-1c5d-446d-95c0-c45d35163735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f50470f-1c5d-446d-95c0-c45d35163735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9051b419-cdfd-4a2f-a60f-6487c76897be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:14 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Volume cdafce88-b19f-4c55-9976-d032f956472f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdafce88-b19f-4c55-9976-d032f956472f', 'volume_size': 1} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f7ee863-dfa9-4b4e-8c3a-0aaef02ac912,created_at=2026-07-09T22:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-345480961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f7ee863-dfa9-4b4e-8c3a-0aaef02ac912,host='devstack@QuobyteHD#QuobyteHD',id=cdafce88-b19f-4c55-9976-d032f956472f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f0569a6d6a4c16bf2d862cb390cca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:14Z,use_quota=True,user_id='83fd00ed17224d0fac71144a649c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b16bb022-8ce7-4203-a1d3-b560bed8fc5a),volume_type_id=b16bb022-8ce7-4203-a1d3-b560bed8fc5a)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Creating volume cdafce88-b19f-4c55-9976-d032f956472f {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:14 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:37:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:14 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f 1073741824 Jul 10 00:37:14 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:15 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f 1073741824" returned: 0 in 1.550s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:15 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f Jul 10 00:37:15 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:16 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f" returned: 0 in 0.782s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.402s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9051b419-cdfd-4a2f-a60f-6487c76897be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdafce88-b19f-4c55-9976-d032f956472f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aaa81e-86ac-4e38-bf19-c1817bf88602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:16 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Volume volume-cdafce88-b19f-4c55-9976-d032f956472f (cdafce88-b19f-4c55-9976-d032f956472f): created successfully Jul 10 00:37:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aaa81e-86ac-4e38-bf19-c1817bf88602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Flow 'volume_create_manager' (8e26dcea-7bb6-4d42-b85d-ddc708adf11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-86c569fa-db77-40ad-a0e8-50c2af8125e8 tempest-GroupsTest-578649179 None] Created volume successfully. Jul 10 00:37:18 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6a19c959-db4d-453e-bf03-6c911777c233 tempest-GroupsTest-578649179 None] Update group completed successfully. Jul 10 00:37:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f39c6347-3be9-4f17-ab42-dce2e304dc48 tempest-GroupsTest-578649179 None] Update group completed successfully. Jul 10 00:37:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Acquiring lock "cinder-quobyte-72922c6d-4752-4042-88c8-e2bdde648ca8" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Lock "cinder-quobyte-72922c6d-4752-4042-88c8-e2bdde648ca8" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[82803cea-d580-47f8-a11a-63ce282c92ba]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:22 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 Jul 10 00:37:22 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:23 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8" returned: 0 in 1.135s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:23 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8 Jul 10 00:37:23 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:24 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-72922c6d-4752-4042-88c8-e2bdde648ca8" returned: 0 in 1.458s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Lock "cinder-quobyte-72922c6d-4752-4042-88c8-e2bdde648ca8" released by "delete_volume" :: held 2.684s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Acquiring lock "cinder-quobyte-cdafce88-b19f-4c55-9976-d032f956472f" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Lock "cinder-quobyte-cdafce88-b19f-4c55-9976-d032f956472f" acquired by "delete_volume" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:25 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce82a26-36c7-440e-a2d8-ed8076ff8b42]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:25 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f Jul 10 00:37:25 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:26 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f" returned: 0 in 1.263s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:26 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f Jul 10 00:37:26 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:27 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cdafce88-b19f-4c55-9976-d032f956472f" returned: 0 in 0.966s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Lock "cinder-quobyte-cdafce88-b19f-4c55-9976-d032f956472f" released by "delete_volume" :: held 2.317s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Created reservations ['d1491f8b-09cd-4b8f-a97a-47a6bf6adc7e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:27 devstack cinder-volume[87452]: WARNING cinder.quota [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1827962689 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1827962689, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:27 devstack cinder-volume[87452]: WARNING cinder.quota [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1827962689 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1827962689, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Created reservations ['ed5676b6-0f5f-4573-bbdd-963b622e0694', 'cf8209fa-9782-4272-a4b7-8f31c3c5bbb6', 'abbe5e26-c47c-4448-9da4-5eb34bec7380', 'c799819c-5ba3-487d-8086-24175f1bd69b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Created reservations ['f9a4757a-2e43-446a-8dc8-97a55eeddfce', '053465d3-7bf8-4195-86df-29070213b3b2', 'f21c906d-125b-41ce-8d27-6e920d5d9663', 'cec60660-9618-4be2-b09e-39694677ef5b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:27 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:37:27 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:28 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.691s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:28 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:28 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-9464bfaa-6d1b-4829-a9f6-3e2465523443 tempest-GroupsTest-578649179 None] Delete group completed successfully. Jul 10 00:37:37 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=69,cinder:DELETE=3,cinder:UPDATE=74,cinder:INSERT=14 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:37:37 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=66,cinder:UPDATE=73,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Flow 'volume_create_manager' (1d281c86-3168-448b-bc1f-d08afca1cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1a75ea-dc55-4113-9e97-b0ba5c20981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1a75ea-dc55-4113-9e97-b0ba5c20981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-312917947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec355a6-cd9b-4914-87fe-3e1a8a12c025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9514c16907a4f2a9a8317570cbbaab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:39Z,use_quota=True,user_id='93e429ce7298463bac554558ca40591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0235ae0a-1b4b-4c44-a2fe-be8770cb513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0235ae0a-1b4b-4c44-a2fe-be8770cb513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165b192d-f783-440d-b6cd-a4db29badcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165b192d-f783-440d-b6cd-a4db29badcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec355a6-cd9b-4914-87fe-3e1a8a12c025', 'volume_name': 'volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10f8f76-9096-46f7-84d8-ad8fea72f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10f8f76-9096-46f7-84d8-ad8fea72f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ef6e20-21a6-449d-9c2d-91b15def7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:39 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Volume bec355a6-cd9b-4914-87fe-3e1a8a12c025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025', 'volume_size': 1} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-312917947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec355a6-cd9b-4914-87fe-3e1a8a12c025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9514c16907a4f2a9a8317570cbbaab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:39Z,use_quota=True,user_id='93e429ce7298463bac554558ca40591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Creating volume bec355a6-cd9b-4914-87fe-3e1a8a12c025 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:39 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:37:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:39 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 1073741824 Jul 10 00:37:39 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:40 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 1073741824" returned: 0 in 1.064s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:40 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 Jul 10 00:37:40 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:40 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025" returned: 0 in 0.676s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ef6e20-21a6-449d-9c2d-91b15def7218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01424d09-4610-49f3-a4be-a03e1cb2ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:40 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Volume volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 (bec355a6-cd9b-4914-87fe-3e1a8a12c025): created successfully Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01424d09-4610-49f3-a4be-a03e1cb2ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Flow 'volume_create_manager' (1d281c86-3168-448b-bc1f-d08afca1cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f2bd60b0-3822-43f9-aebf-292879a6171f tempest-AttachVolumeShelveTestJSON-1777091174 None] Created volume successfully. Jul 10 00:37:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-a2e0b587-9b24-4b34-aa71-d8ff3c656451 req-214e9b69-f3ab-49a3-8830-3692d7e9f65a tempest-AttachVolumeTestJSON-416492636 None] Terminate volume connection completed successfully. Jul 10 00:37:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-a2e0b587-9b24-4b34-aa71-d8ff3c656451 req-214e9b69-f3ab-49a3-8830-3692d7e9f65a tempest-AttachVolumeTestJSON-416492636 None] Deleting attachment b589927f-3c54-452e-b216-ccdd3228c6d9. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Flow 'volume_create_manager' (d84d9152-472f-469c-b8a7-9af1cfc8adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ed047-b5b4-4474-bce5-b88ac5055e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ed047-b5b4-4474-bce5-b88ac5055e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1974514269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9109ba-223f-45f7-a8d4-a9856bd8f36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def453dbe7d04ed9937f44d6e9fa2bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:48Z,use_quota=True,user_id='51a662077f1e4f6ab4ea982e0eb5c3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f855b1e0-bbc2-4265-b44c-4a0ec40fdcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f855b1e0-bbc2-4265-b44c-4a0ec40fdcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6f18bd-299e-40dd-be90-b066fa2553fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6f18bd-299e-40dd-be90-b066fa2553fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9109ba-223f-45f7-a8d4-a9856bd8f36b', 'volume_name': 'volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3088ca12-91ed-4f22-8094-24240fc2d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3088ca12-91ed-4f22-8094-24240fc2d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc0cfc2-8f8a-4471-ab1a-c1eda7b6cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Volume de9109ba-223f-45f7-a8d4-a9856bd8f36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b', 'volume_size': 1} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1974514269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9109ba-223f-45f7-a8d4-a9856bd8f36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='def453dbe7d04ed9937f44d6e9fa2bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:48Z,use_quota=True,user_id='51a662077f1e4f6ab4ea982e0eb5c3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Creating volume de9109ba-223f-45f7-a8d4-a9856bd8f36b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:48 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:37:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:48 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b 1073741824 Jul 10 00:37:48 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:50 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b 1073741824" returned: 0 in 1.539s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:50 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b Jul 10 00:37:50 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:51 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b" returned: 0 in 1.214s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] <== create_volume: return (2835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.838s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc0cfc2-8f8a-4471-ab1a-c1eda7b6cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe321d3-3d06-4158-ae17-9e1549c38265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:51 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Volume volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b (de9109ba-223f-45f7-a8d4-a9856bd8f36b): created successfully Jul 10 00:37:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe321d3-3d06-4158-ae17-9e1549c38265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Flow 'volume_create_manager' (d84d9152-472f-469c-b8a7-9af1cfc8adc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0ce716ae-c0af-403c-a881-021d43cc9cf5 tempest-TestMinimumBasicScenario-825648741 None] Created volume successfully. Jul 10 00:37:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:37:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:53 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:37:53 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:54 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.957s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:37:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 8 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:37:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:37:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-73575bf6-afb2-48ab-a18a-33d1c0d409a5 req-e430b116-849b-436e-a976-fa1e58dd8fc3 tempest-TestMinimumBasicScenario-825648741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-73575bf6-afb2-48ab-a18a-33d1c0d409a5 req-e430b116-849b-436e-a976-fa1e58dd8fc3 tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:55 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[76200367-dbd9-4c71-9795-d0c177f66c35]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-73575bf6-afb2-48ab-a18a-33d1c0d409a5 req-e430b116-849b-436e-a976-fa1e58dd8fc3 tempest-TestMinimumBasicScenario-825648741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:55 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b Jul 10 00:37:55 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:56 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-73575bf6-afb2-48ab-a18a-33d1c0d409a5 req-e430b116-849b-436e-a976-fa1e58dd8fc3 tempest-TestMinimumBasicScenario-825648741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b" returned: 0 in 1.206s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-73575bf6-afb2-48ab-a18a-33d1c0d409a5 req-e430b116-849b-436e-a976-fa1e58dd8fc3 tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.245s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-73575bf6-afb2-48ab-a18a-33d1c0d409a5 req-e430b116-849b-436e-a976-fa1e58dd8fc3 tempest-TestMinimumBasicScenario-825648741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6be03987-2ea1-4483-a4ea-5ea2f37fed3d', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:37:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-73575bf6-afb2-48ab-a18a-33d1c0d409a5 req-e430b116-849b-436e-a976-fa1e58dd8fc3 tempest-TestMinimumBasicScenario-825648741 None] attachment_update completed successfully. Jul 10 00:38:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-0ab66ff5-1d22-48d0-a510-1f1a461e64e6 req-cca9cb01-bd85-438f-bc30-d44057dfb7d0 tempest-AttachVolumeShelveTestJSON-1777091174 None] No connector for attachment f1cccad0-96ad-43c0-a34d-1b8076ce5bfa; skipping storage backend terminate_connection call. {{(pid=87452) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 00:38:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-0ab66ff5-1d22-48d0-a510-1f1a461e64e6 req-cca9cb01-bd85-438f-bc30-d44057dfb7d0 tempest-AttachVolumeShelveTestJSON-1777091174 None] Deleting attachment f1cccad0-96ad-43c0-a34d-1b8076ce5bfa. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Flow 'volume_create_manager' (1d2cd05d-4aff-41fe-8db7-fecc7d722267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04466212-0885-4304-8e9c-8f52bac27314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04466212-0885-4304-8e9c-8f52bac27314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843659641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e5c291-0f84-4bf4-a652-98b27c6293f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e82763a6d146e8a61d6fa47d6dc60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:06Z,use_quota=True,user_id='31609e4ed28644789f12ddbaabef8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949509c7-dbdd-4b30-a82d-6e10fd2e83f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949509c7-dbdd-4b30-a82d-6e10fd2e83f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcf28af-9966-4768-9b54-25fb505b3779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:06 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcf28af-9966-4768-9b54-25fb505b3779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69e5c291-0f84-4bf4-a652-98b27c6293f2', 'volume_name': 'volume-69e5c291-0f84-4bf4-a652-98b27c6293f2', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd97515-a9a1-490f-b82f-e69676a60b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd97515-a9a1-490f-b82f-e69676a60b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce925f3a-e264-4cbf-92f6-c2f4e9caae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:07 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Volume 69e5c291-0f84-4bf4-a652-98b27c6293f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69e5c291-0f84-4bf4-a652-98b27c6293f2', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Trying to clone 69e5c291-0f84-4bf4-a652-98b27c6293f2 from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:38:07 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedbbffb-6441-4ed8-9c0b-b1a520174091]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:07 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD Jul 10 00:38:07 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:08 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD" returned: 0 in 1.075s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:08 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 is fetched for user 31609e4ed28644789f12ddbaabef8006. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:38:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5151a1-8936-4922-b1ea-9cc71ce5f20e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:09 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD Jul 10 00:38:09 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:09 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD" returned: 0 in 0.975s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-843659641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e5c291-0f84-4bf4-a652-98b27c6293f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e82763a6d146e8a61d6fa47d6dc60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:06Z,use_quota=True,user_id='31609e4ed28644789f12ddbaabef8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Creating volume 69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:09 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:38:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:09 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 1073741824 Jul 10 00:38:09 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:10 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 1073741824" returned: 0 in 1.027s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:11 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 Jul 10 00:38:11 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:11 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2" returned: 0 in 0.878s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:11 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Attempting download of 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 69e5c291-0f84-4bf4-a652-98b27c6293f2. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:38:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[306cd5db-cc0c-4700-a2df-34227a13aca8]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_84ah97sa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:12 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_84ah97sa Jul 10 00:38:12 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:12 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_84ah97sa" returned: 0 in 0.780s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_84ah97sa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:12 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_84ah97sa Jul 10 00:38:12 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:14 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_84ah97sa" returned: 1 in 1.476s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_84ah97sa' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:14 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[200b50f6-5274-416e-ab4f-2c32c244507a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:14 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD Jul 10 00:38:14 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:15 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD" returned: 0 in 1.373s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:15 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] 2b7c4d0c-270c-4121-95ac-c2aa29014583 was qcow2, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:38:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:15 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 Jul 10 00:38:15 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:18 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2" returned: 0 in 3.173s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:18 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_n3j_9rjxdevstack@QuobyteHD, size 112.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:38:18 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Converted 112.00 MB image at 35.25 MB/s Jul 10 00:38:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:18 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 1G Jul 10 00:38:18 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:20 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 1G" returned: 0 in 1.171s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99efb9b-201d-4759-a2ef-e48fdd60333e]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:20 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 Jul 10 00:38:20 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:20 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=9,cinder:SELECT=14,cinder:INSERT=3 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:38:21 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2" returned: 0 in 1.098s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:21 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 Jul 10 00:38:21 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:21 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:38:22 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2" returned: 1 in 1.131s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Downloaded image 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 69e5c291-0f84-4bf4-a652-98b27c6293f2 successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 for user 31609e4ed28644789f12ddbaabef8006 is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Marking volume 69e5c291-0f84-4bf4-a652-98b27c6293f2 as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Copying metadata from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 to 69e5c291-0f84-4bf4-a652-98b27c6293f2. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Creating volume glance metadata for volume 69e5c291-0f84-4bf4-a652-98b27c6293f2 backed by image 2b7c4d0c-270c-4121-95ac-c2aa29014583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce925f3a-e264-4cbf-92f6-c2f4e9caae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e5c291-0f84-4bf4-a652-98b27c6293f2', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d79051-d9e7-438b-a685-2bce31d4ab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:22 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Volume volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 (69e5c291-0f84-4bf4-a652-98b27c6293f2): created successfully Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d79051-d9e7-438b-a685-2bce31d4ab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Flow 'volume_create_manager' (1d2cd05d-4aff-41fe-8db7-fecc7d722267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:22 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-052423e2-0efd-4f35-b40f-cd40a5fcb715 tempest-VolumesImageMetadata-1455975000 None] Created volume successfully. Jul 10 00:38:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Acquiring lock "cinder-69e5c291-0f84-4bf4-a652-98b27c6293f2-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Lock "cinder-69e5c291-0f84-4bf4-a652-98b27c6293f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Acquiring lock "cinder-quobyte-69e5c291-0f84-4bf4-a652-98b27c6293f2" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Lock "cinder-quobyte-69e5c291-0f84-4bf4-a652-98b27c6293f2" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7538701-2bc5-45d4-bc2f-51a9fea2c326]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:24 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 Jul 10 00:38:24 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2" returned: 0 in 1.193s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:25 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:26 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 Jul 10 00:38:26 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:27 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2" returned: 1 in 1.240s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:27 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2 Jul 10 00:38:27 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:27 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-69e5c291-0f84-4bf4-a652-98b27c6293f2" returned: 0 in 0.729s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Lock "cinder-quobyte-69e5c291-0f84-4bf4-a652-98b27c6293f2" released by "delete_volume" :: held 3.291s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Created reservations ['475c0473-919e-4c8a-957d-3bf78e3a81ee', 'a7be0d85-fa85-47d3-9004-d6e0b68ebe8a', '4cadb763-261c-436c-97b5-4a77b4fd20ac', '8aa9e3e8-c271-4632-8c70-53081e1ea3c8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:28 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:38:28 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:28 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.688s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:28 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Deleted volume successfully. Jul 10 00:38:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0debd3c0-fcdd-459f-8639-c0e342109cf6 tempest-VolumesImageMetadata-1455975000 None] Lock "cinder-69e5c291-0f84-4bf4-a652-98b27c6293f2-delete_volume" released by "delete_volume" :: held 4.331s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:33 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Flow 'volume_create_manager' (74d190ce-4f9e-491c-9f49-938f8123a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2023eb34-94a9-44b6-8fae-9a23f8ef1577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2023eb34-94a9-44b6-8fae-9a23f8ef1577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-349269967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8592254a-a4f4-450b-98ec-3f9076e5269b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beae5a941bc8446282d7c945b74451b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:34Z,use_quota=True,user_id='fb00feef45fe4913800c9f68d954d4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369fcad6-b383-4cba-bc8d-5889766c32b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369fcad6-b383-4cba-bc8d-5889766c32b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9c0d33-cec6-439e-9b1c-5ae523b2fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9c0d33-cec6-439e-9b1c-5ae523b2fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8592254a-a4f4-450b-98ec-3f9076e5269b', 'volume_name': 'volume-8592254a-a4f4-450b-98ec-3f9076e5269b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de8a1f0-a64a-4526-ab41-0fc599e53e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de8a1f0-a64a-4526-ab41-0fc599e53e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8548102-710c-4cd2-b12a-7cb88c11a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Volume 8592254a-a4f4-450b-98ec-3f9076e5269b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8592254a-a4f4-450b-98ec-3f9076e5269b', 'volume_size': 1} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-349269967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8592254a-a4f4-450b-98ec-3f9076e5269b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beae5a941bc8446282d7c945b74451b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:34Z,use_quota=True,user_id='fb00feef45fe4913800c9f68d954d4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Creating volume 8592254a-a4f4-450b-98ec-3f9076e5269b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:34 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:34 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b 1073741824 Jul 10 00:38:34 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:34 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b 1073741824" returned: 0 in 0.823s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:34 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b Jul 10 00:38:34 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:35 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b" returned: 0 in 0.626s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8548102-710c-4cd2-b12a-7cb88c11a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8592254a-a4f4-450b-98ec-3f9076e5269b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164dd7f6-abbe-45eb-b638-e7e4be2961c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Volume volume-8592254a-a4f4-450b-98ec-3f9076e5269b (8592254a-a4f4-450b-98ec-3f9076e5269b): created successfully Jul 10 00:38:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164dd7f6-abbe-45eb-b638-e7e4be2961c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Flow 'volume_create_manager' (74d190ce-4f9e-491c-9f49-938f8123a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b19f57a9-fd9f-443f-8801-cbec34bc8358 tempest-VolumesTransfersTest-1217440666 None] Created volume successfully. Jul 10 00:38:36 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2885e687-779e-477f-b2b0-5ac215dd6f48 tempest-VolumesTransfersTest-1644546606 None] Transfer volume completed successfully. Jul 10 00:38:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Acquiring lock "cinder-8592254a-a4f4-450b-98ec-3f9076e5269b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Lock "cinder-8592254a-a4f4-450b-98ec-3f9076e5269b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Acquiring lock "cinder-quobyte-8592254a-a4f4-450b-98ec-3f9076e5269b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Lock "cinder-quobyte-8592254a-a4f4-450b-98ec-3f9076e5269b" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:38 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f494d48-d737-42cf-953e-a8c37b19aa3a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:38 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b Jul 10 00:38:38 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:38 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b" returned: 0 in 0.937s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:39 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b Jul 10 00:38:39 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:39 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8592254a-a4f4-450b-98ec-3f9076e5269b" returned: 0 in 0.698s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Lock "cinder-quobyte-8592254a-a4f4-450b-98ec-3f9076e5269b" released by "delete_volume" :: held 1.695s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Created reservations ['a112bf49-8a51-4918-ba19-26a53366762a', '4c7f44d5-d405-4df2-ab3f-38c24b67a6d1', '36cc96d4-3377-4a2e-8d59-f9adeab2a5ee', '0a8791e7-5633-4255-bd4b-dd81d75084ae'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:39 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:38:39 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:40 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.702s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Deleted volume successfully. Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8c2f87da-bf16-4b49-aa82-89d2f9ffa9f4 tempest-VolumesTransfersTest-885797358 None] Lock "cinder-8592254a-a4f4-450b-98ec-3f9076e5269b-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Flow 'volume_create_manager' (3dc6ef18-6cf9-4198-aa18-0d9674a26541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be98eaf7-4f8c-451a-a627-964d04686552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be98eaf7-4f8c-451a-a627-964d04686552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1731361050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9ad338-a341-43df-9bd4-6fa8c586d1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beae5a941bc8446282d7c945b74451b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:41Z,use_quota=True,user_id='fb00feef45fe4913800c9f68d954d4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dbd087-129b-4428-8c1f-eebf6df0db5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dbd087-129b-4428-8c1f-eebf6df0db5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02af4a09-e94e-4f27-8f23-57f2ea45ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02af4a09-e94e-4f27-8f23-57f2ea45ec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9ad338-a341-43df-9bd4-6fa8c586d1bc', 'volume_name': 'volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d3250-2a4d-4d17-82e2-e79cda90b6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d3250-2a4d-4d17-82e2-e79cda90b6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565d554a-ca7f-4ab4-9fa9-8bbd169a43c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:40 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Volume 1d9ad338-a341-43df-9bd4-6fa8c586d1bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc', 'volume_size': 1} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1731361050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9ad338-a341-43df-9bd4-6fa8c586d1bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beae5a941bc8446282d7c945b74451b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:41Z,use_quota=True,user_id='fb00feef45fe4913800c9f68d954d4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Creating volume 1d9ad338-a341-43df-9bd4-6fa8c586d1bc {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:40 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:38:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:40 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc 1073741824 Jul 10 00:38:40 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Flow 'volume_create_manager' (a2463723-2aaf-4aec-9db7-bf55a03b7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb91eb7b-d409-4943-bcd4-b72463d43f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb91eb7b-d409-4943-bcd4-b72463d43f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2092433987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf8e3a9-4cbd-473b-b999-0fdb447f4f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29deb56a39140d7acd673c91154867e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:41Z,use_quota=True,user_id='c6d83738e5cc41dd96afe93e2a66847f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44de1f4a-dac8-45f4-888a-771b7ab0ec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44de1f4a-dac8-45f4-888a-771b7ab0ec8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c84526d-3920-4963-9bcf-980234064cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c84526d-3920-4963-9bcf-980234064cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf8e3a9-4cbd-473b-b999-0fdb447f4f37', 'volume_name': 'volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95c3203-a140-4f35-a764-c455b3508339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95c3203-a140-4f35-a764-c455b3508339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e322501-5741-4224-9ace-9d43879c34f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:41 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Volume baf8e3a9-4cbd-473b-b999-0fdb447f4f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37', 'volume_size': 1} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:41 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc 1073741824" returned: 0 in 0.809s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:41 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc Jul 10 00:38:41 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:42 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc" returned: 0 in 0.627s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2092433987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf8e3a9-4cbd-473b-b999-0fdb447f4f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29deb56a39140d7acd673c91154867e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:41Z,use_quota=True,user_id='c6d83738e5cc41dd96afe93e2a66847f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Creating volume baf8e3a9-4cbd-473b-b999-0fdb447f4f37 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:42 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565d554a-ca7f-4ab4-9fa9-8bbd169a43c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:42 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 1073741824 Jul 10 00:38:42 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b96e8f-fd82-463e-b962-638ca8115287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:42 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Volume volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc (1d9ad338-a341-43df-9bd4-6fa8c586d1bc): created successfully Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b96e8f-fd82-463e-b962-638ca8115287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Flow 'volume_create_manager' (3dc6ef18-6cf9-4198-aa18-0d9674a26541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:42 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-054d05c0-f24e-4d6d-bab0-f050c64f0b25 tempest-VolumesTransfersTest-1217440666 None] Created volume successfully. Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Acquiring lock "cinder-1d9ad338-a341-43df-9bd4-6fa8c586d1bc-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Lock "cinder-1d9ad338-a341-43df-9bd4-6fa8c586d1bc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Acquiring lock "cinder-quobyte-1d9ad338-a341-43df-9bd4-6fa8c586d1bc" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Lock "cinder-quobyte-1d9ad338-a341-43df-9bd4-6fa8c586d1bc" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:43 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 1073741824" returned: 0 in 0.880s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeefb05-0ea1-4887-baab-173edb93d11a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:43 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 Jul 10 00:38:43 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:43 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc Jul 10 00:38:43 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:43 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37" returned: 0 in 0.641s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e322501-5741-4224-9ace-9d43879c34f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1e535c-5b8b-4103-a16e-ab1f16338d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:44 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Volume volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 (baf8e3a9-4cbd-473b-b999-0fdb447f4f37): created successfully Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1e535c-5b8b-4103-a16e-ab1f16338d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Flow 'volume_create_manager' (a2463723-2aaf-4aec-9db7-bf55a03b7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-68b3ecce-0793-478e-8083-46befdd43e59 tempest-AttachVolumeTestJSON-416492636 None] Created volume successfully. Jul 10 00:38:44 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc" returned: 0 in 0.801s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:44 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc Jul 10 00:38:44 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:44 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d9ad338-a341-43df-9bd4-6fa8c586d1bc" returned: 0 in 0.635s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Lock "cinder-quobyte-1d9ad338-a341-43df-9bd4-6fa8c586d1bc" released by "delete_volume" :: held 1.480s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Created reservations ['8ee46fbd-6af4-49c6-b1d7-442d0df1cba2', '3cedc3f6-9bc4-4d24-b2ca-681c2aa4f5f1', '38aed03c-b32d-401a-ba09-ed8756bc28c9', '161ab574-c1e3-407e-8d05-dbeede9a2f73'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:44 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:38:44 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:45 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.703s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:45 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Deleted volume successfully. Jul 10 00:38:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-28b05c46-b66c-40d8-bb03-c9b5fe2c566b tempest-VolumesTransfersTest-885797358 None] Lock "cinder-1d9ad338-a341-43df-9bd4-6fa8c586d1bc-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-9b1bd129-1be7-480c-b366-c93bfe9b4af8 req-c1fdc048-1629-4ea8-9ae9-47c4ab065b59 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-9b1bd129-1be7-480c-b366-c93bfe9b4af8 req-c1fdc048-1629-4ea8-9ae9-47c4ab065b59 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:48 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0bded5-4d66-48d9-b926-b0b8775883aa]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-9b1bd129-1be7-480c-b366-c93bfe9b4af8 req-c1fdc048-1629-4ea8-9ae9-47c4ab065b59 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:48 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 Jul 10 00:38:48 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:49 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-9b1bd129-1be7-480c-b366-c93bfe9b4af8 req-c1fdc048-1629-4ea8-9ae9-47c4ab065b59 tempest-AttachVolumeTestJSON-416492636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37" returned: 0 in 1.016s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-9b1bd129-1be7-480c-b366-c93bfe9b4af8 req-c1fdc048-1629-4ea8-9ae9-47c4ab065b59 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.057s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-9b1bd129-1be7-480c-b366-c93bfe9b4af8 req-c1fdc048-1629-4ea8-9ae9-47c4ab065b59 tempest-AttachVolumeTestJSON-416492636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e41cf0c0-0dbe-49dd-8a78-15777ada937e', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:38:49 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-9b1bd129-1be7-480c-b366-c93bfe9b4af8 req-c1fdc048-1629-4ea8-9ae9-47c4ab065b59 tempest-AttachVolumeTestJSON-416492636 None] attachment_update completed successfully. Jul 10 00:38:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-327a7a1c-aded-43d3-932e-71c19d107ea0 req-22eda0f7-8292-49e2-bd32-bcac747ec1d6 tempest-TestMinimumBasicScenario-825648741 None] Terminate volume connection completed successfully. Jul 10 00:38:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-327a7a1c-aded-43d3-932e-71c19d107ea0 req-22eda0f7-8292-49e2-bd32-bcac747ec1d6 tempest-TestMinimumBasicScenario-825648741 None] Deleting attachment 6be03987-2ea1-4483-a4ea-5ea2f37fed3d. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Flow 'volume_create_manager' (ee04a172-23bf-4b28-861f-af6a8000dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7675f4ef-9fe5-4759-8a35-d8ab6fa236ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7675f4ef-9fe5-4759-8a35-d8ab6fa236ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-275188302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a94b18c-2d8a-4df8-9e7c-12ed02031f82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1c03be05a584bc18086fa84713576a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:52Z,use_quota=True,user_id='29efad7c1d7449abb810ff8c0e543cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f0945f-d725-48cd-982b-7fa0d57d06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f0945f-d725-48cd-982b-7fa0d57d06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12c8a43-e60e-4006-ab53-16df689c3578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12c8a43-e60e-4006-ab53-16df689c3578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a94b18c-2d8a-4df8-9e7c-12ed02031f82', 'volume_name': 'volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8c97ef-212b-4aee-8e8d-357d7de7c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8c97ef-212b-4aee-8e8d-357d7de7c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc68191b-dc1b-40a3-9b51-f84717148b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:52 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Volume 0a94b18c-2d8a-4df8-9e7c-12ed02031f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82', 'volume_size': 1} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-275188302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a94b18c-2d8a-4df8-9e7c-12ed02031f82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1c03be05a584bc18086fa84713576a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:52Z,use_quota=True,user_id='29efad7c1d7449abb810ff8c0e543cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Creating volume 0a94b18c-2d8a-4df8-9e7c-12ed02031f82 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:52 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:38:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:52 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 1073741824 Jul 10 00:38:52 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Acquiring lock "cinder-de9109ba-223f-45f7-a8d4-a9856bd8f36b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Lock "cinder-de9109ba-223f-45f7-a8d4-a9856bd8f36b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Acquiring lock "cinder-quobyte-de9109ba-223f-45f7-a8d4-a9856bd8f36b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Lock "cinder-quobyte-de9109ba-223f-45f7-a8d4-a9856bd8f36b" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722858f-aac2-4f3a-a026-75a1d068bd27]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:53 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b Jul 10 00:38:53 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:53 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 1073741824" returned: 0 in 1.239s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:53 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:38:53 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:53 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 Jul 10 00:38:53 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Flow 'volume_create_manager' (dff3c688-a623-402a-b63c-eba9eff2a7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f61a8e8-9a17-42a6-a1b6-c6d36a79fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f61a8e8-9a17-42a6-a1b6-c6d36a79fefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070504664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4039c8a-f18c-4926-88cd-4fee485b4f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29deb56a39140d7acd673c91154867e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:54Z,use_quota=True,user_id='c6d83738e5cc41dd96afe93e2a66847f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262d55dd-8056-4ad7-965a-b4e76ffd2c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262d55dd-8056-4ad7-965a-b4e76ffd2c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274cd393-fe6c-48dc-bc1c-9f026d329734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274cd393-fe6c-48dc-bc1c-9f026d329734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4039c8a-f18c-4926-88cd-4fee485b4f5f', 'volume_name': 'volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a77cbd-3ace-4a1c-a925-a816a89d9b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a77cbd-3ace-4a1c-a925-a816a89d9b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c107db2c-76c8-40b3-a617-d9f920bd6d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Volume e4039c8a-f18c-4926-88cd-4fee485b4f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f', 'volume_size': 1} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:54 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b" returned: 0 in 1.127s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:54 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b Jul 10 00:38:54 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:54 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.944s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:38:54 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82" returned: 0 in 1.061s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.397s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070504664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4039c8a-f18c-4926-88cd-4fee485b4f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d29deb56a39140d7acd673c91154867e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:54Z,use_quota=True,user_id='c6d83738e5cc41dd96afe93e2a66847f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Creating volume e4039c8a-f18c-4926-88cd-4fee485b4f5f {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:54 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc68191b-dc1b-40a3-9b51-f84717148b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fe2b97-70c7-4333-9b3a-a8ccb62fb38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:54 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f 1073741824 Jul 10 00:38:54 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Volume volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 (0a94b18c-2d8a-4df8-9e7c-12ed02031f82): created successfully Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fe2b97-70c7-4333-9b3a-a8ccb62fb38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Flow 'volume_create_manager' (ee04a172-23bf-4b28-861f-af6a8000dbed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:54 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8f54ebbb-f39d-404f-8fd4-20f05558eb94 tempest-VolumesListTestJSON-1690197701 None] Created volume successfully. Jul 10 00:38:55 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-de9109ba-223f-45f7-a8d4-a9856bd8f36b" returned: 0 in 0.728s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Lock "cinder-quobyte-de9109ba-223f-45f7-a8d4-a9856bd8f36b" released by "delete_volume" :: held 1.910s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Created reservations ['c7a26f01-60ab-43b8-842a-7aa99836ed0e', 'e1257382-a629-4af2-a11b-b05b9e179449', '3c29fb9b-6114-4a94-a766-da1739ad33d3', '5613cdb8-86ab-47f9-9e95-e3fc3f0aeb6d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:55 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:38:55 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:55 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f 1073741824" returned: 0 in 1.033s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:55 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f Jul 10 00:38:55 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:56 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.843s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Deleted volume successfully. Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-654b57ec-3dee-4b5c-b62d-2b70c38b30bc tempest-TestMinimumBasicScenario-825648741 None] Lock "cinder-de9109ba-223f-45f7-a8d4-a9856bd8f36b-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Flow 'volume_create_manager' (4aad2461-c535-4f70-a63a-aad3b2ca01ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef85bf0-453d-4f85-a0ca-234515da1493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef85bf0-453d-4f85-a0ca-234515da1493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-859631573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1c03be05a584bc18086fa84713576a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:56Z,use_quota=True,user_id='29efad7c1d7449abb810ff8c0e543cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031d5a15-6767-4adb-aba9-83453c79e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031d5a15-6767-4adb-aba9-83453c79e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0560a92-cddd-4d25-8157-c2c3c8777186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0560a92-cddd-4d25-8157-c2c3c8777186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb', 'volume_name': 'volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643529cb-06f5-44cf-ab3d-6b98ad09bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643529cb-06f5-44cf-ab3d-6b98ad09bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba2d24d-44bf-418b-bbc8-67777d6bbb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Volume a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb', 'volume_size': 1} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:56 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f" returned: 0 in 0.837s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-859631573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1c03be05a584bc18086fa84713576a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:56Z,use_quota=True,user_id='29efad7c1d7449abb810ff8c0e543cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Creating volume a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:56 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:56 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb 1073741824 Jul 10 00:38:56 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c107db2c-76c8-40b3-a617-d9f920bd6d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b3550-647a-4922-8da3-bf706b4159b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Volume volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f (e4039c8a-f18c-4926-88cd-4fee485b4f5f): created successfully Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b3550-647a-4922-8da3-bf706b4159b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Flow 'volume_create_manager' (dff3c688-a623-402a-b63c-eba9eff2a7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2626c593-723e-490b-af75-ded13d5619be tempest-AttachVolumeTestJSON-416492636 None] Created volume successfully. Jul 10 00:38:57 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb 1073741824" returned: 0 in 1.093s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:57 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb Jul 10 00:38:57 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:58 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba2d24d-44bf-418b-bbc8-67777d6bbb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f070029-208f-482a-a632-ad17ebd41c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Volume volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb (a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb): created successfully Jul 10 00:38:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f070029-208f-482a-a632-ad17ebd41c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Flow 'volume_create_manager' (4aad2461-c535-4f70-a63a-aad3b2ca01ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2e64fd59-c6bb-4fde-af6a-b1051ed56d00 tempest-VolumesListTestJSON-1690197701 None] Created volume successfully. Jul 10 00:38:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Acquiring lock "cinder-bec355a6-cd9b-4914-87fe-3e1a8a12c025-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "cinder-bec355a6-cd9b-4914-87fe-3e1a8a12c025-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Acquiring lock "cinder-quobyte-bec355a6-cd9b-4914-87fe-3e1a8a12c025" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "cinder-quobyte-bec355a6-cd9b-4914-87fe-3e1a8a12c025" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:59 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d51a142-a8fb-4183-9aae-4c5b333060d9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:00 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 Jul 10 00:39:00 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Flow 'volume_create_manager' (a336705d-b79d-4366-9d44-c975d81e3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a431668d-cea1-49a6-a410-ea5188f18049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a431668d-cea1-49a6-a410-ea5188f18049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-735966314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1c03be05a584bc18086fa84713576a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:00Z,use_quota=True,user_id='29efad7c1d7449abb810ff8c0e543cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038bd2d4-0640-4510-b07b-4db4a2ae5788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038bd2d4-0640-4510-b07b-4db4a2ae5788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff28057c-1afd-413e-b305-f5f4abf18c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff28057c-1afd-413e-b305-f5f4abf18c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e', 'volume_name': 'volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612634a3-8fb9-4697-b942-d7b8c6c1a7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612634a3-8fb9-4697-b942-d7b8c6c1a7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98138aff-f6b0-4315-9e2d-677eb3f17b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Volume 5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e', 'volume_size': 1} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-735966314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e1c03be05a584bc18086fa84713576a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:00Z,use_quota=True,user_id='29efad7c1d7449abb810ff8c0e543cf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Creating volume 5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:00 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:00 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e 1073741824 Jul 10 00:39:00 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-0ee7b69e-841c-4792-9524-1d26b3afb1a9 req-65538921-84ae-4147-9bdb-787aa23c934d tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:00 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025" returned: 0 in 0.856s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:00 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025 Jul 10 00:39:00 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:01 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e 1073741824" returned: 0 in 0.905s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:01 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e Jul 10 00:39:01 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:01 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bec355a6-cd9b-4914-87fe-3e1a8a12c025" returned: 0 in 0.712s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "cinder-quobyte-bec355a6-cd9b-4914-87fe-3e1a8a12c025" released by "delete_volume" :: held 1.637s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Created reservations ['345eda61-e1b7-4818-aa85-8927110e5000', 'a1c67bd8-f3e2-44ac-a04c-c419e8e50d82', '3627880c-7d30-4bf6-a739-03f6ec04a6d5', '948d8943-b3eb-4fc2-b34f-6d560305bcf8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:01 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:01 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:01 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e" returned: 0 in 0.719s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-0ee7b69e-841c-4792-9524-1d26b3afb1a9 req-65538921-84ae-4147-9bdb-787aa23c934d tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.524s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98138aff-f6b0-4315-9e2d-677eb3f17b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51ff7dd-c26f-4d1b-8cdc-c34996c874a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cfcc85-4483-4559-af94-2467ee865289]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-0ee7b69e-841c-4792-9524-1d26b3afb1a9 req-65538921-84ae-4147-9bdb-787aa23c934d tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:02 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Volume volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e (5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e): created successfully Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51ff7dd-c26f-4d1b-8cdc-c34996c874a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Flow 'volume_create_manager' (a336705d-b79d-4366-9d44-c975d81e3159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-15667003-8aee-4755-a371-adcb45d670a9 tempest-VolumesListTestJSON-1690197701 None] Created volume successfully. Jul 10 00:39:02 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f Jul 10 00:39:02 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:02 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.937s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Deleted volume successfully. Jul 10 00:39:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f6ede77-dfb6-41a5-b47b-64eb62abdf4b tempest-AttachVolumeShelveTestJSON-1777091174 None] Lock "cinder-bec355a6-cd9b-4914-87fe-3e1a8a12c025-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:03 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-0ee7b69e-841c-4792-9524-1d26b3afb1a9 req-65538921-84ae-4147-9bdb-787aa23c934d tempest-AttachVolumeTestJSON-416492636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f" returned: 0 in 1.095s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-0ee7b69e-841c-4792-9524-1d26b3afb1a9 req-65538921-84ae-4147-9bdb-787aa23c934d tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.134s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-0ee7b69e-841c-4792-9524-1d26b3afb1a9 req-65538921-84ae-4147-9bdb-787aa23c934d tempest-AttachVolumeTestJSON-416492636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de15ee90-b171-477a-83aa-375d32b2776c', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:39:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-0ee7b69e-841c-4792-9524-1d26b3afb1a9 req-65538921-84ae-4147-9bdb-787aa23c934d tempest-AttachVolumeTestJSON-416492636 None] attachment_update completed successfully. Jul 10 00:39:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "cinder-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "cinder-quobyte-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-quobyte-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:05 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda837ea-5a73-41f3-8d55-fad133e0126d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:05 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e Jul 10 00:39:05 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:06 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e" returned: 0 in 1.085s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:06 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e Jul 10 00:39:06 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:07 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e" returned: 0 in 0.965s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-quobyte-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e" released by "delete_volume" :: held 2.140s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Created reservations ['5d150c63-a939-4b54-bffe-9c6762702717', 'e9b7e203-e08a-4810-8ab8-7d4e3aea04f9', 'f8e952a4-8321-4f8f-83ca-77172f6ce5e6', 'c8df128b-f274-4979-9d39-d20f5f98d252'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:07 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:07 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:08 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.027s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Deleted volume successfully. Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ded684bf-f9ff-49f7-94e3-5ffdf1a5c765 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-5c20c8be-bb8d-48ca-a1e4-d0378af1cb0e-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "cinder-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "cinder-quobyte-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-quobyte-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b8f2fd-c6a2-48b4-a17d-02d302304696]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:08 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb Jul 10 00:39:08 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:09 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb" returned: 0 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:09 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb Jul 10 00:39:09 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-21ac8f18-26b4-42cf-b8c8-cd4421ecac45 req-7ca89e28-61de-44dd-a3b7-60ddf00b7a77 tempest-AttachVolumeTestJSON-416492636 None] Terminate volume connection completed successfully. Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-21ac8f18-26b4-42cf-b8c8-cd4421ecac45 req-7ca89e28-61de-44dd-a3b7-60ddf00b7a77 tempest-AttachVolumeTestJSON-416492636 None] Deleting attachment e41cf0c0-0dbe-49dd-8a78-15777ada937e. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:39:10 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb" returned: 0 in 0.777s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-quobyte-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb" released by "delete_volume" :: held 1.667s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Created reservations ['1956cb9a-85f0-46ab-b084-b8f773aaf420', '9cdca664-aa84-462d-b20b-4e673c2b01b7', '12c77239-cdf5-4e13-aa60-fcdb11999905', '75bfbe96-5433-4d10-be6b-8377628be9cf'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:10 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:10 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "cinder-0a94b18c-2d8a-4df8-9e7c-12ed02031f82-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-0a94b18c-2d8a-4df8-9e7c-12ed02031f82-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "cinder-quobyte-0a94b18c-2d8a-4df8-9e7c-12ed02031f82" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-quobyte-0a94b18c-2d8a-4df8-9e7c-12ed02031f82" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edf9f4e-0420-4799-92b7-cef303f3f4d7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:11 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 Jul 10 00:39:11 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:11 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.858s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:11 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Deleted volume successfully. Jul 10 00:39:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa032a3a-0448-44c2-aa53-7cfa0e4b3914 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-a15a1c6f-4b85-40b3-8ab1-ff5c328bcebb-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e7f0fd8-69d2-4aab-b4e6-cc95d6cf9d3a tempest-BackendsCapabilitiesAdminTestsJSON-1151168572 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7494354248047, 'free_capacity_gb': 1775.7494354248047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87452) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 00:39:11 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82" returned: 0 in 0.914s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:11 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82 Jul 10 00:39:11 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fa68010-83c6-4f51-89fe-e7b53a6c34bc tempest-BackendsCapabilitiesAdminTestsJSON-1151168572 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7494354248047, 'free_capacity_gb': 1775.7494354248047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87452) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 00:39:12 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0a94b18c-2d8a-4df8-9e7c-12ed02031f82" returned: 0 in 0.704s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-quobyte-0a94b18c-2d8a-4df8-9e7c-12ed02031f82" released by "delete_volume" :: held 1.671s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Created reservations ['524d0baf-ad0d-407b-a723-28e7575f2462', '6372a65b-f313-460a-b974-cbb364dbecfe', '6db63908-13b6-4400-8388-069bf3003462', '6cc07ec5-ba86-4ff6-a284-9fcab800056e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-bc4e76a4-caa6-41e4-a940-fbc05cf8e733 req-c70125ae-5fc5-44e9-aa24-b71af674e802 tempest-AttachVolumeTestJSON-416492636 None] Terminate volume connection completed successfully. Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-bc4e76a4-caa6-41e4-a940-fbc05cf8e733 req-c70125ae-5fc5-44e9-aa24-b71af674e802 tempest-AttachVolumeTestJSON-416492636 None] Deleting attachment de15ee90-b171-477a-83aa-375d32b2776c. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:12 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:12 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:13 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.863s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:13 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Deleted volume successfully. Jul 10 00:39:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87bfa6a6-e946-4bc6-8d15-4e63332bdc28 tempest-VolumesListTestJSON-1690197701 None] Lock "cinder-0a94b18c-2d8a-4df8-9e7c-12ed02031f82-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:15 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (b3895e79-55cb-4e0b-84e7-d1f0d9e17628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7adab6-e5eb-4d63-aa62-e9f22a29e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7adab6-e5eb-4d63-aa62-e9f22a29e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-649484876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131a15ee-cb2c-4c82-88b9-4fca50b4a9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:16Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2f6ad3-571c-404f-8dd4-2ea65aef4256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2f6ad3-571c-404f-8dd4-2ea65aef4256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e42902-4e69-47bb-9760-51c7c9adc565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e42902-4e69-47bb-9760-51c7c9adc565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131a15ee-cb2c-4c82-88b9-4fca50b4a9d5', 'volume_name': 'volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135667e-4ed2-44ce-926e-e85565e97865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135667e-4ed2-44ce-926e-e85565e97865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b68e17-378a-4eb7-bb2f-51ea598bdc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:16 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume 131a15ee-cb2c-4c82-88b9-4fca50b4a9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5', 'volume_size': 1} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-649484876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131a15ee-cb2c-4c82-88b9-4fca50b4a9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:16Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Creating volume 131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:16 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:16 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 1073741824 Jul 10 00:39:16 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:17 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 1073741824" returned: 0 in 1.060s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:17 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 Jul 10 00:39:17 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Flow 'volume_create_manager' (41f8f51c-7425-4ffa-b7a4-358f0c86d5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efdc60d-2fc4-4175-b0a5-bfb63fd3133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efdc60d-2fc4-4175-b0a5-bfb63fd3133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-386187812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98b913c-efcc-40d9-9d17-507164b2c60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ab61240ebd4105ac6ca98a17397c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:18Z,use_quota=True,user_id='c8ac51d3f9244375acc712ab00f4f6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdbea01-f664-4bec-993d-ceaf8288959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdbea01-f664-4bec-993d-ceaf8288959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bb0bb4-0158-4642-8e10-acfcba9413a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bb0bb4-0158-4642-8e10-acfcba9413a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98b913c-efcc-40d9-9d17-507164b2c60a', 'volume_name': 'volume-e98b913c-efcc-40d9-9d17-507164b2c60a', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40f9f04-dca1-4a62-8f0f-4328bcb36fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40f9f04-dca1-4a62-8f0f-4328bcb36fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991ad65b-305e-4bca-941e-44c2d1d3e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Volume e98b913c-efcc-40d9-9d17-507164b2c60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98b913c-efcc-40d9-9d17-507164b2c60a', 'volume_size': 1} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:18 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" returned: 0 in 1.077s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-386187812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98b913c-efcc-40d9-9d17-507164b2c60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ab61240ebd4105ac6ca98a17397c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:18Z,use_quota=True,user_id='c8ac51d3f9244375acc712ab00f4f6e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Creating volume e98b913c-efcc-40d9-9d17-507164b2c60a {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:18 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:18 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a 1073741824 Jul 10 00:39:18 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b68e17-378a-4eb7-bb2f-51ea598bdc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2e5b38-3fc6-4fb9-a9e9-851153478587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 (131a15ee-cb2c-4c82-88b9-4fca50b4a9d5): created successfully Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2e5b38-3fc6-4fb9-a9e9-851153478587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (b3895e79-55cb-4e0b-84e7-d1f0d9e17628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:18 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fab8a1a0-2218-496f-865c-5e61484b146d tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created volume successfully. Jul 10 00:39:19 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a 1073741824" returned: 0 in 1.096s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:19 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a Jul 10 00:39:19 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2ceb4843-a387-42d1-8483-5de315491b2b tempest-GroupSnapshotsTest-22687373 None] Group tempest-GroupSnapshotsTest-Group-1065478991: creating Jul 10 00:39:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2ceb4843-a387-42d1-8483-5de315491b2b tempest-GroupSnapshotsTest-22687373 None] Group tempest-GroupSnapshotsTest-Group-1065478991: created successfully Jul 10 00:39:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2ceb4843-a387-42d1-8483-5de315491b2b tempest-GroupSnapshotsTest-22687373 None] Create group completed successfully. Jul 10 00:39:20 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a" returned: 0 in 0.666s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.654s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991ad65b-305e-4bca-941e-44c2d1d3e01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98b913c-efcc-40d9-9d17-507164b2c60a', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d583e7c-c243-46f9-a010-a0765dce4d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Creating offline snapshot 844d759c-1f78-42dc-99e6-9985a31933bb of volume 131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:39:20 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Volume volume-e98b913c-efcc-40d9-9d17-507164b2c60a (e98b913c-efcc-40d9-9d17-507164b2c60a): created successfully Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d583e7c-c243-46f9-a010-a0765dce4d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Flow 'volume_create_manager' (41f8f51c-7425-4ffa-b7a4-358f0c86d5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe58d979-a337-4173-a527-6a981f197d77]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-37e4275c-9929-4abc-b334-b310eac78fd1 tempest-VolumesNegativeTest-305060873 None] Created volume successfully. Jul 10 00:39:20 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 Jul 10 00:39:20 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:20 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:20 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb 1G Jul 10 00:39:20 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=93,cinder:INSERT=29,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (ba996ed9-810d-4a35-a030-1a820ed6b3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d8b9cf-e166-4285-9e99-c4c362e4e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d8b9cf-e166-4285-9e99-c4c362e4e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2057656082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89d38d7b-737d-406b-bfb8-6d930dc46f2c,host='devstack@QuobyteHD#QuobyteHD',id=70bcbdd2-4639-4186-8ea5-a627368edb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:21Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79246a2f-8238-442a-9e65-57b30ebadaf0),volume_type_id=79246a2f-8238-442a-9e65-57b30ebadaf0)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d76bcf-937b-4929-9a94-e00c407f58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d76bcf-937b-4929-9a94-e00c407f58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f9bb8a-ee9f-4464-8e0a-2679d0dd9c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f9bb8a-ee9f-4464-8e0a-2679d0dd9c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70bcbdd2-4639-4186-8ea5-a627368edb4a', 'volume_name': 'volume-70bcbdd2-4639-4186-8ea5-a627368edb4a', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8264f4b8-7412-41c6-aa67-a4cf4a48bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8264f4b8-7412-41c6-aa67-a4cf4a48bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4468a0c3-fb4b-4349-9dac-431d4af9ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:21 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Volume 70bcbdd2-4639-4186-8ea5-a627368edb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70bcbdd2-4639-4186-8ea5-a627368edb4a', 'volume_size': 1} Jul 10 00:39:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:22 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb 1G" returned: 0 in 1.106s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:22 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb Jul 10 00:39:22 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:22 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb" returned: 0 in 0.717s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:22 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb is being set with open permissions: ugo+rw Jul 10 00:39:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:22 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb Jul 10 00:39:22 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:23 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb" returned: 0 in 0.686s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:23 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=99,cinder:SELECT=74,cinder:INSERT=24,cinder:DELETE=12 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:39:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:23 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.info Jul 10 00:39:23 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "cinder-e4039c8a-f18c-4926-88cd-4fee485b4f5f-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-e4039c8a-f18c-4926-88cd-4fee485b4f5f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "cinder-quobyte-e4039c8a-f18c-4926-88cd-4fee485b4f5f" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-quobyte-e4039c8a-f18c-4926-88cd-4fee485b4f5f" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8515f5f4-7089-4b32-bff4-9a688638da41]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:24 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.info" returned: 0 in 0.769s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:24 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.info is being set with open permissions: ugo+rw Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:24 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.info Jul 10 00:39:24 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:24 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f Jul 10 00:39:24 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:24 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.info" returned: 0 in 0.656s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.903s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.362s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89d38d7b-737d-406b-bfb8-6d930dc46f2c,created_at=2026-07-09T22:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2057656082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89d38d7b-737d-406b-bfb8-6d930dc46f2c,host='devstack@QuobyteHD#QuobyteHD',id=70bcbdd2-4639-4186-8ea5-a627368edb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:21Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79246a2f-8238-442a-9e65-57b30ebadaf0),volume_type_id=79246a2f-8238-442a-9e65-57b30ebadaf0)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Creating volume 70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:24 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:25 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a 1073741824 Jul 10 00:39:25 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-92aba6bd-4b62-485a-86ab-352e1523361b tempest-CreateVolumesFromSnapshotTest-1879007099 None] Create snapshot completed successfully Jul 10 00:39:25 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f" returned: 0 in 0.808s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:25 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f Jul 10 00:39:25 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:25 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4039c8a-f18c-4926-88cd-4fee485b4f5f" returned: 0 in 0.683s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-quobyte-e4039c8a-f18c-4926-88cd-4fee485b4f5f" released by "delete_volume" :: held 1.546s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Created reservations ['54082f42-7f07-46be-a276-910b3f798b5a', '9f79e586-198e-4df5-b2c0-fce76b9b8b46', '70db78f6-3247-4a14-bf52-8d891ec47e03', '7bb8d963-0494-4e4b-a2b0-cbb929d5faa2'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:25 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:25 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:25 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a 1073741824" returned: 0 in 1.011s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:26 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a Jul 10 00:39:26 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (b13ecbcb-25c4-45d4-8686-84f6a2fc2a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9ebe39-b06b-490b-ae84-d3f2e7cc4b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9ebe39-b06b-490b-ae84-d3f2e7cc4b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1400402851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5aff83-e0c6-4523-97a4-b4f8aaa77d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:26Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6d8067-bd1f-4910-943e-f843a9782111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6d8067-bd1f-4910-943e-f843a9782111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50678959-f78d-407c-8dc2-137726cc7af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50678959-f78d-407c-8dc2-137726cc7af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df5aff83-e0c6-4523-97a4-b4f8aaa77d29', 'volume_name': 'volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6137d1-fdff-4467-b456-ee1dd6448fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6137d1-fdff-4467-b456-ee1dd6448fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfb6cb7-0d77-40fb-a684-8ee607d15618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:26 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume df5aff83-e0c6-4523-97a4-b4f8aaa77d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29', 'volume_size': 1} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "cinder-baf8e3a9-4cbd-473b-b999-0fdb447f4f37-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-baf8e3a9-4cbd-473b-b999-0fdb447f4f37-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "cinder-quobyte-baf8e3a9-4cbd-473b-b999-0fdb447f4f37" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-quobyte-baf8e3a9-4cbd-473b-b999-0fdb447f4f37" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6403f95d-bd1e-4997-bd3e-ab687daf2ecc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (cf9c5f28-f8cf-46e4-b686-59dae1d43033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e708c48-ec97-4439-a368-d03c9bdc5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e708c48-ec97-4439-a368-d03c9bdc5296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091198805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be17dffd-70e6-4164-83cf-612c8556dff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:27Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b154a408-817d-4de5-b357-4b0e06a7fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 Jul 10 00:39:27 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b154a408-817d-4de5-b357-4b0e06a7fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efc5af2-eee0-40ad-930d-ff5698d81b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efc5af2-eee0-40ad-930d-ff5698d81b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be17dffd-70e6-4164-83cf-612c8556dff4', 'volume_name': 'volume-be17dffd-70e6-4164-83cf-612c8556dff4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de515bf-c2f9-45c5-9ceb-2574a8f9355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de515bf-c2f9-45c5-9ceb-2574a8f9355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99092be4-4877-4538-9cfa-c18c1fadb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume be17dffd-70e6-4164-83cf-612c8556dff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be17dffd-70e6-4164-83cf-612c8556dff4', 'volume_size': 1} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:27 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.301s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Deleted volume successfully. Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3e4bbba9-b0cd-4969-b404-ba19b91f8a9e tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-e4039c8a-f18c-4926-88cd-4fee485b4f5f-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:27 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a" returned: 0 in 1.383s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] <== create_volume: return (2451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.455s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1400402851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5aff83-e0c6-4523-97a4-b4f8aaa77d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:26Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Creating volume df5aff83-e0c6-4523-97a4-b4f8aaa77d29 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:27 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:27 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 1073741824 Jul 10 00:39:27 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4468a0c3-fb4b-4349-9dac-431d4af9ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bcbdd2-4639-4186-8ea5-a627368edb4a', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdea6997-4db0-4f1e-a57b-e6b3e248175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (95d91af2-117d-4083-bbc6-6cd995ca395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929ae8dc-fac6-463e-96cd-54d4516d2ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Volume volume-70bcbdd2-4639-4186-8ea5-a627368edb4a (70bcbdd2-4639-4186-8ea5-a627368edb4a): created successfully Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdea6997-4db0-4f1e-a57b-e6b3e248175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (ba996ed9-810d-4a35-a030-1a820ed6b3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-13d66940-2bef-443a-a75b-028d01f5d3c7 tempest-GroupSnapshotsTest-22687373 None] Created volume successfully. Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929ae8dc-fac6-463e-96cd-54d4516d2ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668948102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd5bf23-7145-424e-9f2c-b714db3c1152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:27Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869a9360-a565-4449-a1ce-0bfab4a8be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869a9360-a565-4449-a1ce-0bfab4a8be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca51be1-ae9f-44e3-a20c-77614484a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca51be1-ae9f-44e3-a20c-77614484a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd5bf23-7145-424e-9f2c-b714db3c1152', 'volume_name': 'volume-2cd5bf23-7145-424e-9f2c-b714db3c1152', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec62ce2-283a-4108-8fb4-bc8e0fcfa77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec62ce2-283a-4108-8fb4-bc8e0fcfa77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e289d3-5a1a-462f-bf63-25647d08b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:27 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume 2cd5bf23-7145-424e-9f2c-b714db3c1152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd5bf23-7145-424e-9f2c-b714db3c1152', 'volume_size': 1} Jul 10 00:39:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (ece5251f-2a2d-4c36-8659-95ef8eeebe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260b798e-3a87-49ed-8539-a4b41ea4fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260b798e-3a87-49ed-8539-a4b41ea4fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1195834664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9869f077-32e9-48a7-ba08-417e54dcebb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:28Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14301d86-e63e-40d9-97b4-340ae108b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14301d86-e63e-40d9-97b4-340ae108b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abe1698-344d-4c87-9249-4a8d78cc6903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abe1698-344d-4c87-9249-4a8d78cc6903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9869f077-32e9-48a7-ba08-417e54dcebb7', 'volume_name': 'volume-9869f077-32e9-48a7-ba08-417e54dcebb7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ae3cfd-e7f4-423b-aac8-eaadd4b918e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ae3cfd-e7f4-423b-aac8-eaadd4b918e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed03ea-4de9-4e65-bcaa-b2796fd800d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume 9869f077-32e9-48a7-ba08-417e54dcebb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9869f077-32e9-48a7-ba08-417e54dcebb7', 'volume_size': 1} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:28 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37" returned: 0 in 1.552s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:28 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37 Jul 10 00:39:28 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (173461d4-8c62-4af4-8cae-19720192d439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0aac8a-b581-4082-8dc1-89e032900d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0aac8a-b581-4082-8dc1-89e032900d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1597941867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98f0545-7e5e-4807-ac63-b366e55adfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:28Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34888f86-8598-4a2d-9b65-f5a86a36c8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34888f86-8598-4a2d-9b65-f5a86a36c8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bf1366-3e7c-4b41-8e35-70ee928ada88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bf1366-3e7c-4b41-8e35-70ee928ada88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98f0545-7e5e-4807-ac63-b366e55adfd7', 'volume_name': 'volume-d98f0545-7e5e-4807-ac63-b366e55adfd7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c602c20d-0434-4219-9ca7-387fc8677087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c602c20d-0434-4219-9ca7-387fc8677087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92ba7a3-e87e-462f-a8fc-8eddbbc022d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:28 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume d98f0545-7e5e-4807-ac63-b366e55adfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98f0545-7e5e-4807-ac63-b366e55adfd7', 'volume_size': 1} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 1073741824" returned: 0 in 1.274s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:28 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 Jul 10 00:39:28 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] GroupSnapshot 81b3c1e6-0777-4c3c-add4-2a948447aa0f: creating. Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Group snapshot 81b3c1e6-0777-4c3c-add4-2a948447aa0f: creating. {{(pid=87452) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:29 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-baf8e3a9-4cbd-473b-b999-0fdb447f4f37" returned: 0 in 1.114s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-quobyte-baf8e3a9-4cbd-473b-b999-0fdb447f4f37" released by "delete_volume" :: held 2.760s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Created reservations ['4bfee19d-9542-45a0-aeec-471be7e449c1', '15574976-b71b-4182-8e6f-9daea5490a8a', 'c64f3bc7-1c67-4e02-b3b1-612ca712f2ba', '17a7c490-7582-4900-802b-7ea11a82e9c4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:29 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:29 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:29 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29" returned: 0 in 0.990s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] <== create_volume: return (2378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.383s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.758s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091198805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be17dffd-70e6-4164-83cf-612c8556dff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:27Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Creating volume be17dffd-70e6-4164-83cf-612c8556dff4 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:29 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:29 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 1073741824 Jul 10 00:39:29 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfb6cb7-0d77-40fb-a684-8ee607d15618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea67e4-d409-4887-bd4c-58c060f4b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 (df5aff83-e0c6-4523-97a4-b4f8aaa77d29): created successfully Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea67e4-d409-4887-bd4c-58c060f4b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (b13ecbcb-25c4-45d4-8686-84f6a2fc2a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fc6767c3-9b3c-434f-8a55-0a778f61c589 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created volume successfully. Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "cinder-4402b886-e2b8-4f44-9e89-099d6d50c854-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-4402b886-e2b8-4f44-9e89-099d6d50c854-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "cinder-quobyte-4402b886-e2b8-4f44-9e89-099d6d50c854" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-quobyte-4402b886-e2b8-4f44-9e89-099d6d50c854" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b4f1ec-9c26-409e-b748-93259d9a970a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:30 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.846s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Deleted volume successfully. Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f2b279db-db88-4238-bbc1-5b5f9f1ad925 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-baf8e3a9-4cbd-473b-b999-0fdb447f4f37-delete_volume" released by "delete_volume" :: held 3.904s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:30 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 Jul 10 00:39:30 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:30 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 1073741824" returned: 0 in 1.007s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:30 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 Jul 10 00:39:30 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:31 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854" returned: 0 in 0.889s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:31 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854 Jul 10 00:39:31 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:31 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4" returned: 0 in 0.651s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.853s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668948102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd5bf23-7145-424e-9f2c-b714db3c1152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:27Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Creating volume 2cd5bf23-7145-424e-9f2c-b714db3c1152 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:31 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:31 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 1073741824 Jul 10 00:39:31 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99092be4-4877-4538-9cfa-c18c1fadb25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be17dffd-70e6-4164-83cf-612c8556dff4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962fc7a3-4fb0-437c-a16d-5000380bb93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:31 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume volume-be17dffd-70e6-4164-83cf-612c8556dff4 (be17dffd-70e6-4164-83cf-612c8556dff4): created successfully Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962fc7a3-4fb0-437c-a16d-5000380bb93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (cf9c5f28-f8cf-46e4-b686-59dae1d43033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:31 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-9d70dbc0-309e-49be-bda4-1f3df5cd35cb tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created volume successfully. Jul 10 00:39:31 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4402b886-e2b8-4f44-9e89-099d6d50c854" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-quobyte-4402b886-e2b8-4f44-9e89-099d6d50c854" released by "delete_volume" :: held 1.649s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Created reservations ['fab91ed2-fd0c-40e0-a96d-347549f63748', '7d3e906f-5695-41a5-afc9-d1ad1c445a4f', '54c229e9-b12e-4b92-bd13-a01dfef5a1ec', '28ebad8a-1bc0-472a-9d9b-007f68ebda0e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:32 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:32 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:32 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 1073741824" returned: 0 in 0.961s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:32 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 Jul 10 00:39:32 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:32 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.759s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Deleted volume successfully. Jul 10 00:39:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4249726-734a-4705-9ccd-1395beefe9d8 tempest-AttachVolumeTestJSON-416492636 None] Lock "cinder-4402b886-e2b8-4f44-9e89-099d6d50c854-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:33 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152" returned: 0 in 0.686s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.054s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1195834664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9869f077-32e9-48a7-ba08-417e54dcebb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:28Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Creating volume 9869f077-32e9-48a7-ba08-417e54dcebb7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:33 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e289d3-5a1a-462f-bf63-25647d08b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd5bf23-7145-424e-9f2c-b714db3c1152', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:33 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 1073741824 Jul 10 00:39:33 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0db836-25f3-40f2-9632-23bb2b4c27ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:33 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 (2cd5bf23-7145-424e-9f2c-b714db3c1152): created successfully Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0db836-25f3-40f2-9632-23bb2b4c27ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (95d91af2-117d-4083-bbc6-6cd995ca395a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7e7bceea-371f-427f-864e-91724a247a29 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created volume successfully. Jul 10 00:39:34 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 1073741824" returned: 0 in 1.180s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:34 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 Jul 10 00:39:34 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:35 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7" returned: 0 in 0.756s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.530s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1597941867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98f0545-7e5e-4807-ac63-b366e55adfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36691e6ce9dc4f91b1c2a19c74863191',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:28Z,use_quota=True,user_id='b950cc1b33c24059a3dad00d052dbbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Creating volume d98f0545-7e5e-4807-ac63-b366e55adfd7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:35 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:35 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 1073741824 Jul 10 00:39:35 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed03ea-4de9-4e65-bcaa-b2796fd800d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9869f077-32e9-48a7-ba08-417e54dcebb7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb4aec3-0f02-4cb0-b936-d866ddb97599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:35 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume volume-9869f077-32e9-48a7-ba08-417e54dcebb7 (9869f077-32e9-48a7-ba08-417e54dcebb7): created successfully Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb4aec3-0f02-4cb0-b936-d866ddb97599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (ece5251f-2a2d-4c36-8659-95ef8eeebe51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f43c2553-4c64-4543-b74e-fd4405c14ac3 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created volume successfully. Jul 10 00:39:36 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 1073741824" returned: 0 in 1.067s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:36 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 Jul 10 00:39:36 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:37 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7" returned: 0 in 0.770s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.854s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92ba7a3-e87e-462f-a8fc-8eddbbc022d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98f0545-7e5e-4807-ac63-b366e55adfd7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda4c8be-3633-40a4-83c3-a430cc859e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Creating offline snapshot 22e57719-322c-4cc6-add5-903361ad654e of volume 70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:39:37 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Volume volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 (d98f0545-7e5e-4807-ac63-b366e55adfd7): created successfully Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda4c8be-3633-40a4-83c3-a430cc859e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Flow 'volume_create_manager' (173461d4-8c62-4af4-8cae-19720192d439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4f3307-ab22-49c7-a299-dafcd07cf017]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-acb30545-3dda-4b66-8166-d3bfe1573b35 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created volume successfully. Jul 10 00:39:37 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a Jul 10 00:39:37 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-d98f0545-7e5e-4807-ac63-b366e55adfd7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-d98f0545-7e5e-4807-ac63-b366e55adfd7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-d98f0545-7e5e-4807-ac63-b366e55adfd7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-d98f0545-7e5e-4807-ac63-b366e55adfd7" acquired by "delete_volume" :: waited 0.056s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b9884-8121-4b92-9c46-8e6223a1e149]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:38 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 Jul 10 00:39:38 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:39 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7" returned: 0 in 1.222s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:39 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a" returned: 0 in 1.749s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:39 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7 Jul 10 00:39:39 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:39 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e 1G Jul 10 00:39:39 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:39 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d98f0545-7e5e-4807-ac63-b366e55adfd7" returned: 0 in 0.946s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-d98f0545-7e5e-4807-ac63-b366e55adfd7" released by "delete_volume" :: held 2.255s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created reservations ['70ecbe87-7c86-46df-9c10-2cfe6e9059df', '45de8d77-93d8-479a-8cfe-3e82f138604f', '8034f0f9-3c97-4f1a-a56c-18f39731180d', '1e226e1c-e690-4ab4-b5a1-55c9c0fb7d96'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:40 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:40 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:40 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e 1G" returned: 0 in 1.242s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70bcbdd2-4639-4186-8ea5-a627368edb4a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:40 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70bcbdd2-4639-4186-8ea5-a627368edb4a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e Jul 10 00:39:40 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:40 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.819s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-9869f077-32e9-48a7-ba08-417e54dcebb7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Deleted volume successfully. Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-9869f077-32e9-48a7-ba08-417e54dcebb7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6e0c795-073b-410b-8c04-40c60b8e4469 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-d98f0545-7e5e-4807-ac63-b366e55adfd7-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-9869f077-32e9-48a7-ba08-417e54dcebb7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-9869f077-32e9-48a7-ba08-417e54dcebb7" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[21213605-ef83-4c1b-8821-335881270533]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:41 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70bcbdd2-4639-4186-8ea5-a627368edb4a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e" returned: 0 in 0.891s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:41 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:39:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:41 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e Jul 10 00:39:41 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:41 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 Jul 10 00:39:41 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:42 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e" returned: 0 in 1.053s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:42 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.info Jul 10 00:39:42 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:42 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7" returned: 0 in 1.256s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:42 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7 Jul 10 00:39:42 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:43 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.info" returned: 0 in 0.900s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:43 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:43 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.info Jul 10 00:39:43 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:43 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9869f077-32e9-48a7-ba08-417e54dcebb7" returned: 0 in 0.940s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-9869f077-32e9-48a7-ba08-417e54dcebb7" released by "delete_volume" :: held 2.238s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created reservations ['659511ba-2e82-475f-8628-fb48e8e4c876', '1b91d739-0170-4602-a768-a9f6206992a6', 'e767c436-e19b-4179-a352-8bf85b500cac', '9a61c72e-e56b-447b-8936-d386afc5c163'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:43 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:43 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:43 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.info" returned: 0 in 0.718s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.738s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e4aab08e-e012-4ccf-8006-d1f51b36364e tempest-GroupSnapshotsTest-22687373 None] group_snapshot 81b3c1e6-0777-4c3c-add4-2a948447aa0f: created successfully Jul 10 00:39:44 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.799s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Deleted volume successfully. Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c5cd8e8c-f0d9-4305-a5c3-ae9388837d5c tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-9869f077-32e9-48a7-ba08-417e54dcebb7-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-2cd5bf23-7145-424e-9f2c-b714db3c1152-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-2cd5bf23-7145-424e-9f2c-b714db3c1152-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-2cd5bf23-7145-424e-9f2c-b714db3c1152" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-2cd5bf23-7145-424e-9f2c-b714db3c1152" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d019303e-5245-4aa2-94b6-d7bd34237629]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:44 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 Jul 10 00:39:44 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:45 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152" returned: 0 in 0.946s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:45 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152 Jul 10 00:39:45 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-22e57719-322c-4cc6-add5-903361ad654e-29392a86-c337-4c27-b8b4-f38020f2544d" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-22e57719-322c-4cc6-add5-903361ad654e-29392a86-c337-4c27-b8b4-f38020f2544d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Creating volume 29392a86-c337-4c27-b8b4-f38020f2544d from snapshot 22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-29392a86-c337-4c27-b8b4-f38020f2544d" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-29392a86-c337-4c27-b8b4-f38020f2544d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] snapshot: 22e57719-322c-4cc6-add5-903361ad654e, volume: 29392a86-c337-4c27-b8b4-f38020f2544d, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b78eef-6c8f-4e0e-870c-e5f7bf6a95f5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:45 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e Jul 10 00:39:45 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:46 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2cd5bf23-7145-424e-9f2c-b714db3c1152" returned: 0 in 0.828s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-2cd5bf23-7145-424e-9f2c-b714db3c1152" released by "delete_volume" :: held 1.832s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created reservations ['d6c9f408-7756-4f52-b8d9-c78e52fe67d5', '036b2e89-7c41-4a5c-8170-820bf8197d1e', '2bf0df0d-ae1c-46ac-a732-e6357edc9ed7', 'f14e0d1d-9d6e-4e9a-9558-0500f68893b4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:46 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:46 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:46 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e" returned: 0 in 0.864s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70bcbdd2-4639-4186-8ea5-a627368edb4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1615f8-5681-40c9-83b4-2ab872d69802]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-be17dffd-70e6-4164-83cf-612c8556dff4-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-be17dffd-70e6-4164-83cf-612c8556dff4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:46 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a Jul 10 00:39:46 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-be17dffd-70e6-4164-83cf-612c8556dff4" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-be17dffd-70e6-4164-83cf-612c8556dff4" acquired by "delete_volume" :: waited 0.038s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7446d6-2c0e-4326-8f86-d9840c0ad2e1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:47 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 Jul 10 00:39:47 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:47 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.187s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:47 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Deleted volume successfully. Jul 10 00:39:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ee24069-fa1a-4e1c-b770-73c8cfbd8ada tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-2cd5bf23-7145-424e-9f2c-b714db3c1152-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:47 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a" returned: 0 in 1.176s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:47 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:39:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:47 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d Jul 10 00:39:47 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:48 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4" returned: 0 in 1.173s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:48 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4 Jul 10 00:39:48 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:48 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-be17dffd-70e6-4164-83cf-612c8556dff4" returned: 0 in 0.816s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-be17dffd-70e6-4164-83cf-612c8556dff4" released by "delete_volume" :: held 2.045s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created reservations ['3c871d06-b04e-4174-b865-4b93ceb03ff7', '8e0a919b-3d38-43ef-9fa0-8fb41f77ed58', 'ef6d7c70-c8fb-4441-98d5-916b95a26160', '640545e4-d996-4146-b6b7-2575b47c3870'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:49 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:49 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-df5aff83-e0c6-4523-97a4-b4f8aaa77d29-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-df5aff83-e0c6-4523-97a4-b4f8aaa77d29-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-df5aff83-e0c6-4523-97a4-b4f8aaa77d29" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-df5aff83-e0c6-4523-97a4-b4f8aaa77d29" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8032a49-5cec-429d-950f-c1cd75fa4066]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:50 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 Jul 10 00:39:50 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:51 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 2.036s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:51 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Deleted volume successfully. Jul 10 00:39:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f0bb8ec5-b670-4522-85d3-8de9e4645cc2 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-be17dffd-70e6-4164-83cf-612c8556dff4-delete_volume" released by "delete_volume" :: held 4.472s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:51 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29" returned: 0 in 1.873s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:51 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29 Jul 10 00:39:51 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:53 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:53 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:53 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-df5aff83-e0c6-4523-97a4-b4f8aaa77d29" returned: 0 in 2.211s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-df5aff83-e0c6-4523-97a4-b4f8aaa77d29" released by "delete_volume" :: held 4.210s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created reservations ['ce8a5814-8851-4179-b673-123ca665323a', '1e73cbd5-eef5-4984-8cab-2ca927650bff', 'd0141c08-3a82-4282-9c1c-832f332594d6', '936dd86d-6bb8-43d7-b631-f10217b9efed'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:54 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:39:54 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-844d759c-1f78-42dc-99e6-9985a31933bb-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-844d759c-1f78-42dc-99e6-9985a31933bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-844d759c-1f78-42dc-99e6-9985a31933bb" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-844d759c-1f78-42dc-99e6-9985a31933bb" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Deleting offline snapshot 844d759c-1f78-42dc-99e6-9985a31933bb of volume 131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:39:54 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] snapshot_file for this snap is: volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d" returned: 0 in 6.967s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0f2ec9-2a4f-41c9-98a2-ae21077515fa]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b4770c-cf7a-478e-927e-25be30185621]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:55 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb Jul 10 00:39:55 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:55 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a Jul 10 00:39:55 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:55 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.760s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:39:55 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.503s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Deleted volume successfully. Jul 10 00:39:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f9e787a7-dd07-4e00-be48-9cd68e64aa45 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-df5aff83-e0c6-4523-97a4-b4f8aaa77d29-delete_volume" released by "delete_volume" :: held 6.530s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:56 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb" returned: 0 in 1.180s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:39:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4462bcd-fe69-43e3-b7b4-c0c227466c47]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:56 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a" returned: 0 in 1.284s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:56 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:39:56 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Converted 1024.00 MB image at 146.90 MB/s Jul 10 00:39:56 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:39:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:56 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d Jul 10 00:39:56 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:56 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 Jul 10 00:39:56 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:57 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" returned: 0 in 0.958s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:57 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb Jul 10 00:39:57 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:57 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d" returned: 0 in 0.981s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-29392a86-c337-4c27-b8b4-f38020f2544d" released by "_copy_volume_from_snapshot" :: held 11.445s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-22e57719-322c-4cc6-add5-903361ad654e-29392a86-c337-4c27-b8b4-f38020f2544d" released by "_create_volume_from_snapshot" :: held 11.484s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.505s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cdaf0069-c4b5-41cb-aa0e-14d3ec813448 tempest-GroupSnapshotsTest-22687373 None] Create group from source-snapshot-81b3c1e6-0777-4c3c-add4-2a948447aa0f completed successfully. Jul 10 00:39:58 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb" returned: 0 in 1.194s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:58 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb Jul 10 00:39:58 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-29392a86-c337-4c27-b8b4-f38020f2544d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-29392a86-c337-4c27-b8b4-f38020f2544d" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec454d5-5044-4c2d-849c-af143b956a07]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:58 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d Jul 10 00:39:58 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:59 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5.844d759c-1f78-42dc-99e6-9985a31933bb" returned: 0 in 1.067s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-844d759c-1f78-42dc-99e6-9985a31933bb" released by "_delete_snapshot" :: held 4.635s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" released by "delete_snapshot" :: held 4.688s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:59 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created reservations ['854b3104-5642-4852-851d-0ffa05cc93a0', '8a4cf298-3af6-48d8-a0c1-967016499675', '443ac2e9-f57b-431b-864c-ee15f9bf6d0d', 'a5d09f82-c9d6-4905-943a-2ef39c889dd1'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:59 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Delete snapshot completed successfully. Jul 10 00:39:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ec61bd-c95b-4313-9dd0-e42a5f469593 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-844d759c-1f78-42dc-99e6-9985a31933bb-delete_snapshot" released by "delete_snapshot" :: held 4.959s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:59 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d" returned: 0 in 0.991s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:59 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d Jul 10 00:39:59 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "cinder-quobyte-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6224fd7a-77a8-4c71-a5e3-16915c474c06]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:00 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 Jul 10 00:40:00 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:00 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-29392a86-c337-4c27-b8b4-f38020f2544d" returned: 0 in 0.863s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-29392a86-c337-4c27-b8b4-f38020f2544d" released by "delete_volume" :: held 1.921s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Created reservations ['5b0e80a1-d7a6-4626-8086-227bb27c8465'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:00 devstack cinder-volume[87452]: WARNING cinder.quota [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2011236617 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2011236617, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:40:00 devstack cinder-volume[87452]: WARNING cinder.quota [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2011236617 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2011236617, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Created reservations ['b5b07a9c-d929-4891-adfe-7298202b6669', '7c24e35a-50a1-4df6-80ea-b0359e78fd22', 'e8c3934c-99a4-403a-bad4-bde1ebe769da', '50a2388a-4ec4-4a76-af16-6a0004ee8baf'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:00 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:00 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:01 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] group_snapshot 81b3c1e6-0777-4c3c-add4-2a948447aa0f: deleting Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Acquiring lock "cinder-e98b913c-efcc-40d9-9d17-507164b2c60a-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Lock "cinder-e98b913c-efcc-40d9-9d17-507164b2c60a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] group_snapshot 81b3c1e6-0777-4c3c-add4-2a948447aa0f: deleting {{(pid=87452) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-70bcbdd2-4639-4186-8ea5-a627368edb4a" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Acquiring lock "cinder-quobyte-e98b913c-efcc-40d9-9d17-507164b2c60a" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Lock "cinder-quobyte-e98b913c-efcc-40d9-9d17-507164b2c60a" acquired by "delete_volume" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-70bcbdd2-4639-4186-8ea5-a627368edb4a" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-22e57719-322c-4cc6-add5-903361ad654e" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-22e57719-322c-4cc6-add5-903361ad654e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Deleting offline snapshot 22e57719-322c-4cc6-add5-903361ad654e of volume 70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:40:01 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] snapshot_file for this snap is: volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6670a71-b032-4ba1-92aa-cdafd25bcf35]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[30651eb7-d549-4dd6-b264-488710f45fec]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" returned: 0 in 1.239s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:01 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5 Jul 10 00:40:01 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:01 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:01 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e Jul 10 00:40:01 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.914s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:01 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:01 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f7f622a3-7eb0-46e0-871a-b3e27ce6816a tempest-GroupSnapshotsTest-22687373 None] Delete group completed successfully. Jul 10 00:40:01 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a Jul 10 00:40:01 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:02 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" returned: 0 in 0.757s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-quobyte-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5" released by "delete_volume" :: held 2.089s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Created reservations ['cd785b35-2a75-4fc7-bc1a-4c3577337b05', 'dc2c8b2d-8e60-4470-bd5f-1c0c845f323f', '53690130-5eef-4d08-9802-b95c26338f13', 'fdbcac50-b691-40c2-a4cc-6414bee72773'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:02 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:02 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:02 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e" returned: 0 in 1.059s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70bcbdd2-4639-4186-8ea5-a627368edb4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:40:02 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9003c0db-7259-4ef7-8337-500fe2ed73ac]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a" returned: 0 in 1.141s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:02 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a Jul 10 00:40:02 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:02 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a Jul 10 00:40:02 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:03 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.912s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Deleted volume successfully. Jul 10 00:40:03 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e98b913c-efcc-40d9-9d17-507164b2c60a" returned: 0 in 0.814s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Lock "cinder-quobyte-e98b913c-efcc-40d9-9d17-507164b2c60a" released by "delete_volume" :: held 2.062s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-045a75e3-7c18-4f4d-8262-4ca113b16ae9 tempest-CreateVolumesFromSnapshotTest-1879007099 None] Lock "cinder-131a15ee-cb2c-4c82-88b9-4fca50b4a9d5-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Created reservations ['56b0d2c6-05dc-469b-bc0c-8ae712e2ed0a', '0b570d4e-8e3b-402a-b539-c2c89c95b51f', '5d66ae29-df64-4693-8a25-6e85d319eb88', '5be2dfd3-4be3-4176-b072-20111695fc68'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:03 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a" returned: 0 in 1.051s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:03 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e Jul 10 00:40:03 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:03 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:03 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:04 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.746s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:04 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Deleted volume successfully. Jul 10 00:40:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-69bbe3aa-b60e-47e7-96bd-8c88e8a94b4a tempest-VolumesNegativeTest-305060873 None] Lock "cinder-e98b913c-efcc-40d9-9d17-507164b2c60a-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:04 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e" returned: 0 in 0.922s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:04 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e Jul 10 00:40:04 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:05 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a.22e57719-322c-4cc6-add5-903361ad654e" returned: 0 in 0.777s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-22e57719-322c-4cc6-add5-903361ad654e" released by "_delete_snapshot" :: held 3.947s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-70bcbdd2-4639-4186-8ea5-a627368edb4a" released by "delete_snapshot" :: held 3.984s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:05 devstack cinder-volume[87452]: WARNING cinder.quota [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2011236617 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2011236617, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:40:05 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] Created reservations ['44cf5e5d-55c7-49df-89ad-b277cd21cd76', 'fdb85346-68cd-45fc-9b49-b6544956b821', '111ebfba-1f14-4f6a-8922-2a8dd52adcc5', '3795a322-aba5-4fb5-a5b5-9aee33b28ec8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0ce06f9f-d405-4e5f-b94f-403c10f5035f tempest-GroupSnapshotsTest-22687373 None] group_snapshot 81b3c1e6-0777-4c3c-add4-2a948447aa0f: deleted successfully Jul 10 00:40:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-70bcbdd2-4639-4186-8ea5-a627368edb4a" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-70bcbdd2-4639-4186-8ea5-a627368edb4a" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4639f50-a72b-4db5-bc92-b5465d7499de]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:06 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a Jul 10 00:40:06 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:07 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a" returned: 0 in 0.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:07 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a Jul 10 00:40:07 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:08 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Flow 'volume_create_manager' (16801b0f-6ab5-42f3-a1ec-f9b7804500bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f04e59f-0427-4886-b52c-cf5586b4666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-70bcbdd2-4639-4186-8ea5-a627368edb4a" returned: 0 in 1.022s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f04e59f-0427-4886-b52c-cf5586b4666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62413655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d436de44-95a6-4c7a-861e-056f1827396d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aced0f092634c63a1f6eeabf299c64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:08Z,use_quota=True,user_id='607671b835d549cfb5271a528f8cef90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6070cdde-3168-455a-9fd4-1b82874ba743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6070cdde-3168-455a-9fd4-1b82874ba743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6eb20d-ba3c-4342-8e4f-ea8eed9b52f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6eb20d-ba3c-4342-8e4f-ea8eed9b52f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd436de44-95a6-4c7a-861e-056f1827396d', 'volume_name': 'volume-d436de44-95a6-4c7a-861e-056f1827396d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43f38a9-dccf-4228-aee6-fe61d4d2b633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43f38a9-dccf-4228-aee6-fe61d4d2b633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9dcba0-c15a-403c-8506-f1bf5843741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:08 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Volume d436de44-95a6-4c7a-861e-056f1827396d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d436de44-95a6-4c7a-861e-056f1827396d', 'volume_size': 1} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62413655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d436de44-95a6-4c7a-861e-056f1827396d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aced0f092634c63a1f6eeabf299c64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:08Z,use_quota=True,user_id='607671b835d549cfb5271a528f8cef90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Creating volume d436de44-95a6-4c7a-861e-056f1827396d {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:08 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-70bcbdd2-4639-4186-8ea5-a627368edb4a" released by "delete_volume" :: held 2.158s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:08 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d 1073741824 Jul 10 00:40:08 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Created reservations ['982daf71-7e99-4e27-a5c7-593d13ed9d96'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:08 devstack cinder-volume[87452]: WARNING cinder.db.api [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2011236617'] Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Created reservations ['42c62f49-a9ad-41c8-8d3c-6519a7aea095', '7fc7fad2-8b9e-4c25-b4de-397fe3519986', '2d145743-395f-4d5b-b9d3-3cb14b7adc11', '99810099-e361-41e8-9e1f-5febe7694247'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:08 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:08 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:09 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d 1073741824" returned: 0 in 1.382s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:09 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d Jul 10 00:40:09 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:09 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.993s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e50ecd60-5a61-4473-85f9-871d5fd1139d tempest-GroupSnapshotsTest-22687373 None] Delete group completed successfully. Jul 10 00:40:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a378922c-a5d9-423b-aaf5-c321ed835414 tempest-GroupSnapshotsTest-22687373 None] Group tempest-GroupSnapshotsTest-Group-1019832848: creating Jul 10 00:40:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a378922c-a5d9-423b-aaf5-c321ed835414 tempest-GroupSnapshotsTest-22687373 None] Group tempest-GroupSnapshotsTest-Group-1019832848: created successfully Jul 10 00:40:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a378922c-a5d9-423b-aaf5-c321ed835414 tempest-GroupSnapshotsTest-22687373 None] Create group completed successfully. Jul 10 00:40:10 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d" returned: 0 in 1.057s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] <== create_volume: return (2508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9dcba0-c15a-403c-8506-f1bf5843741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d436de44-95a6-4c7a-861e-056f1827396d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9ed6b7-990f-48ba-b6ba-681dd38dc01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:10 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Volume volume-d436de44-95a6-4c7a-861e-056f1827396d (d436de44-95a6-4c7a-861e-056f1827396d): created successfully Jul 10 00:40:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9ed6b7-990f-48ba-b6ba-681dd38dc01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Flow 'volume_create_manager' (16801b0f-6ab5-42f3-a1ec-f9b7804500bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ca19ffef-aa11-45d1-996f-e8e31f595d7d tempest-ProjectReaderTests-1544513270 None] Created volume successfully. Jul 10 00:40:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Acquiring lock "cinder-d436de44-95a6-4c7a-861e-056f1827396d-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-d436de44-95a6-4c7a-861e-056f1827396d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Acquiring lock "cinder-quobyte-d436de44-95a6-4c7a-861e-056f1827396d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-quobyte-d436de44-95a6-4c7a-861e-056f1827396d" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:11 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1d2c47-0c99-425b-bf38-32ea89fcf3c4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:11 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d Jul 10 00:40:11 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (ea5b657b-5eaa-4147-9f98-3aecbb8bf31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4160d4-bc10-44ba-bff1-867f3c90d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4160d4-bc10-44ba-bff1-867f3c90d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308764796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc344bb-3f19-4a7f-ad68-4e3cbca3508c,host='devstack@QuobyteHD#QuobyteHD',id=97f74f30-9ed4-489e-a8d0-624e1949bae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:12Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d07d72-54ba-440b-837c-5d699caf421e),volume_type_id=32d07d72-54ba-440b-837c-5d699caf421e)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb445b2-ad53-4eb7-9f39-a223b0bf95cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb445b2-ad53-4eb7-9f39-a223b0bf95cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3c6a74-117a-4e6c-bbd5-0b36acf90a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3c6a74-117a-4e6c-bbd5-0b36acf90a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f74f30-9ed4-489e-a8d0-624e1949bae7', 'volume_name': 'volume-97f74f30-9ed4-489e-a8d0-624e1949bae7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7ba2a9-085d-49a3-b674-928269d56f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7ba2a9-085d-49a3-b674-928269d56f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27afdad0-f53a-404e-827d-fb0e16356df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Volume 97f74f30-9ed4-489e-a8d0-624e1949bae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f74f30-9ed4-489e-a8d0-624e1949bae7', 'volume_size': 1} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2dc344bb-3f19-4a7f-ad68-4e3cbca3508c,created_at=2026-07-09T22:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308764796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc344bb-3f19-4a7f-ad68-4e3cbca3508c,host='devstack@QuobyteHD#QuobyteHD',id=97f74f30-9ed4-489e-a8d0-624e1949bae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:12Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d07d72-54ba-440b-837c-5d699caf421e),volume_type_id=32d07d72-54ba-440b-837c-5d699caf421e)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Creating volume 97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:12 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:12 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 1073741824 Jul 10 00:40:12 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:12 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d" returned: 0 in 1.115s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:12 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d Jul 10 00:40:12 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:13 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d436de44-95a6-4c7a-861e-056f1827396d" returned: 0 in 1.049s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-quobyte-d436de44-95a6-4c7a-861e-056f1827396d" released by "delete_volume" :: held 2.246s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:13 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 1073741824" returned: 0 in 1.257s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Created reservations ['0f2d1744-7c5c-44a1-872f-501624e091ff', '1ff95b27-85ab-4dd9-a13a-00645a150a12', 'bb945675-8558-4f3a-8a2c-bc337f56d83e', 'f6977662-7139-40dd-a9c1-71594aa24eac'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:13 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 Jul 10 00:40:13 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:14 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:14 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:14 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.797s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:14 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7" returned: 0 in 0.953s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Deleted volume successfully. Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27afdad0-f53a-404e-827d-fb0e16356df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f74f30-9ed4-489e-a8d0-624e1949bae7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47c7a5e-8a5e-4f82-90d7-e13550dd5f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9f276aeb-624a-45ea-8127-e7bc1bd2e9b8 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-d436de44-95a6-4c7a-861e-056f1827396d-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:14 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Volume volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 (97f74f30-9ed4-489e-a8d0-624e1949bae7): created successfully Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47c7a5e-8a5e-4f82-90d7-e13550dd5f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (ea5b657b-5eaa-4147-9f98-3aecbb8bf31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fd9ddaa3-92bb-4ab4-b085-2a6d3df4bfff tempest-GroupSnapshotsTest-22687373 None] Created volume successfully. Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Flow 'volume_create_manager' (6516c4cf-0f01-42de-9ea3-b6f0c005009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bde18c-53e5-46dd-8b0c-df821e590b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bde18c-53e5-46dd-8b0c-df821e590b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2106686971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a30a34d-08dd-4669-ac2c-039a60b27c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aced0f092634c63a1f6eeabf299c64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:16Z,use_quota=True,user_id='607671b835d549cfb5271a528f8cef90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5887e1c1-5ef2-4287-97b0-6e69bc7212ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5887e1c1-5ef2-4287-97b0-6e69bc7212ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8d4598-0b2f-4a19-9929-61bc161e409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8d4598-0b2f-4a19-9929-61bc161e409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a30a34d-08dd-4669-ac2c-039a60b27c8f', 'volume_name': 'volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9efd0fc-d335-4274-a864-ff7ba9fac250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9efd0fc-d335-4274-a864-ff7ba9fac250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64edbbc3-db64-4999-a7ef-4efb89db7e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:15 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Volume 7a30a34d-08dd-4669-ac2c-039a60b27c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f', 'volume_size': 1} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2106686971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a30a34d-08dd-4669-ac2c-039a60b27c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aced0f092634c63a1f6eeabf299c64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:16Z,use_quota=True,user_id='607671b835d549cfb5271a528f8cef90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Creating volume 7a30a34d-08dd-4669-ac2c-039a60b27c8f {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:15 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:15 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f 1073741824 Jul 10 00:40:15 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:17 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f 1073741824" returned: 0 in 1.124s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:17 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f Jul 10 00:40:17 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (830ad38b-76cd-4985-8e3e-8d8f37b080be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b1103b-214d-4152-a16a-62b00f8e0008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b1103b-214d-4152-a16a-62b00f8e0008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406236687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc344bb-3f19-4a7f-ad68-4e3cbca3508c,host='devstack@QuobyteHD#QuobyteHD',id=34ddb620-51bb-4d06-87c4-01d8df66665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:17Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d07d72-54ba-440b-837c-5d699caf421e),volume_type_id=32d07d72-54ba-440b-837c-5d699caf421e)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c048df1f-34dc-4b02-aaa2-4f42f91a2178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c048df1f-34dc-4b02-aaa2-4f42f91a2178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f406a08-6e0f-4736-927b-2cb6451b4559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f406a08-6e0f-4736-927b-2cb6451b4559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ddb620-51bb-4d06-87c4-01d8df66665b', 'volume_name': 'volume-34ddb620-51bb-4d06-87c4-01d8df66665b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34995a-70f6-40e8-a5a3-d7cafeb7e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34995a-70f6-40e8-a5a3-d7cafeb7e385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a8be15-0ce3-4548-9bac-3066db4a1311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:17 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Volume 34ddb620-51bb-4d06-87c4-01d8df66665b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ddb620-51bb-4d06-87c4-01d8df66665b', 'volume_size': 1} Jul 10 00:40:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:18 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f" returned: 0 in 0.938s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2dc344bb-3f19-4a7f-ad68-4e3cbca3508c,created_at=2026-07-09T22:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1406236687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dc344bb-3f19-4a7f-ad68-4e3cbca3508c,host='devstack@QuobyteHD#QuobyteHD',id=34ddb620-51bb-4d06-87c4-01d8df66665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:17Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d07d72-54ba-440b-837c-5d699caf421e),volume_type_id=32d07d72-54ba-440b-837c-5d699caf421e)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Creating volume 34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:18 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:18 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b 1073741824 Jul 10 00:40:18 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64edbbc3-db64-4999-a7ef-4efb89db7e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baeb09c-8da9-440c-98e6-b57c64f51e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Volume volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f (7a30a34d-08dd-4669-ac2c-039a60b27c8f): created successfully Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0baeb09c-8da9-440c-98e6-b57c64f51e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Flow 'volume_create_manager' (6516c4cf-0f01-42de-9ea3-b6f0c005009b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:18 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-dccde110-e985-43b6-85b8-4bb9d39c898f tempest-ProjectReaderTests-1544513270 None] Created volume successfully. Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Acquiring lock "cinder-7a30a34d-08dd-4669-ac2c-039a60b27c8f-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-7a30a34d-08dd-4669-ac2c-039a60b27c8f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Acquiring lock "cinder-quobyte-7a30a34d-08dd-4669-ac2c-039a60b27c8f" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-quobyte-7a30a34d-08dd-4669-ac2c-039a60b27c8f" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde9c09-a8aa-457b-ba46-dda1cda42066]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:19 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b 1073741824" returned: 0 in 1.380s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:19 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f Jul 10 00:40:19 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:19 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b Jul 10 00:40:19 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:20 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f" returned: 0 in 1.462s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:20 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b" returned: 0 in 1.250s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] <== create_volume: return (2688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:20 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f Jul 10 00:40:20 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a8be15-0ce3-4548-9bac-3066db4a1311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ddb620-51bb-4d06-87c4-01d8df66665b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57f6715-ebdd-4726-adf5-34eb3ac24e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:20 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Volume volume-34ddb620-51bb-4d06-87c4-01d8df66665b (34ddb620-51bb-4d06-87c4-01d8df66665b): created successfully Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57f6715-ebdd-4726-adf5-34eb3ac24e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (830ad38b-76cd-4985-8e3e-8d8f37b080be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0b0ba9c9-9807-478c-a947-809443146a3b tempest-GroupSnapshotsTest-22687373 None] Created volume successfully. Jul 10 00:40:21 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7a30a34d-08dd-4669-ac2c-039a60b27c8f" returned: 0 in 1.041s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-quobyte-7a30a34d-08dd-4669-ac2c-039a60b27c8f" released by "delete_volume" :: held 2.573s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:21 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=114,cinder:UPDATE=159,cinder:INSERT=41,cinder:DELETE=10 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:40:21 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Created reservations ['9a368a9d-6506-4918-8404-ab6ae175f764', 'c6129da8-033b-4481-a8f2-4dfb61dd1728', '9a19ca89-aba9-42e0-a873-ee47e23cb85a', '540b7cde-e2ef-4bc3-93ad-ddcfc6fe7520'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:22 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:22 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:22 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-92e98368-a366-4fd5-834b-424db1d1ba51 tempest-GroupSnapshotsTest-22687373 None] Update group completed successfully. Jul 10 00:40:23 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.305s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:23 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Deleted volume successfully. Jul 10 00:40:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f0bbaff-27f3-4202-8841-b8636282d426 tempest-ProjectReaderTests-1544513270 None] Lock "cinder-7a30a34d-08dd-4669-ac2c-039a60b27c8f-delete_volume" released by "delete_volume" :: held 4.361s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:23 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=132,cinder:UPDATE=160,cinder:INSERT=34,cinder:DELETE=12 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:40:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-21a7ec77-966f-4c36-9106-b880f4c60b65 tempest-GroupSnapshotsTest-22687373 None] Update group completed successfully. Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (c112ae3d-690c-402f-a4fd-43acae34d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d65edc-5681-456a-bd28-17473df2b5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d65edc-5681-456a-bd28-17473df2b5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2017705083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae0acc1-4ebb-45ee-baae-e21675706cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:24Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e324907-d8bf-4110-a446-c8a62235f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e324907-d8bf-4110-a446-c8a62235f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeb8ff9-9801-4fd2-b65b-aa8328e8c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeb8ff9-9801-4fd2-b65b-aa8328e8c076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae0acc1-4ebb-45ee-baae-e21675706cc3', 'volume_name': 'volume-bae0acc1-4ebb-45ee-baae-e21675706cc3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63df0436-e8f9-49e0-9760-0ab7c6aab3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63df0436-e8f9-49e0-9760-0ab7c6aab3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8070e32b-6286-44ad-8c41-3f01b885eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:24 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Volume bae0acc1-4ebb-45ee-baae-e21675706cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae0acc1-4ebb-45ee-baae-e21675706cc3', 'volume_size': 1} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2017705083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae0acc1-4ebb-45ee-baae-e21675706cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:24Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Creating volume bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:24 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:24 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 1073741824 Jul 10 00:40:24 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3646c4ed-8f43-4e04-a4f4-b54b825cc341 tempest-GroupSnapshotsTest-22687373 None] Update group completed successfully. Jul 10 00:40:25 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 1073741824" returned: 0 in 1.150s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:25 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 Jul 10 00:40:25 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d319ff21-d352-4151-8d86-30177e2cac75 tempest-GroupSnapshotsTest-22687373 None] Update group completed successfully. Jul 10 00:40:26 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3" returned: 0 in 0.857s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8070e32b-6286-44ad-8c41-3f01b885eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae0acc1-4ebb-45ee-baae-e21675706cc3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc8358d-9e83-4bc4-a940-292150a1a9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:26 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Volume volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 (bae0acc1-4ebb-45ee-baae-e21675706cc3): created successfully Jul 10 00:40:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc8358d-9e83-4bc4-a940-292150a1a9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (c112ae3d-690c-402f-a4fd-43acae34d44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e7ec9786-ac5f-44f5-9d80-cd794c0e4d58 tempest-VolumesSnapshotTestJSON-425856056 None] Created volume successfully. Jul 10 00:40:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Creating offline snapshot 93a560c8-a089-4de2-bf33-3ea066f7eaaa of volume bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:40:28 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0166f4ca-160b-4011-a235-436c971a680a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:28 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] GroupSnapshot aaa3dfaf-67a8-4e02-b8c9-c1f68096c262: creating. Jul 10 00:40:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Group snapshot aaa3dfaf-67a8-4e02-b8c9-c1f68096c262: creating. {{(pid=87452) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 00:40:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:28 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 Jul 10 00:40:28 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:28 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3" returned: 0 in 0.877s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:28 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa 1G Jul 10 00:40:28 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:29 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa 1G" returned: 0 in 0.856s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:29 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa Jul 10 00:40:29 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:30 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa" returned: 0 in 0.902s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:30 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa is being set with open permissions: ugo+rw Jul 10 00:40:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:30 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa Jul 10 00:40:30 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:31 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa" returned: 0 in 0.763s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:31 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.info Jul 10 00:40:31 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:32 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.info" returned: 0 in 0.684s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:32 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.info is being set with open permissions: ugo+rw Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:32 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.info Jul 10 00:40:32 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:32 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.info" returned: 0 in 0.655s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.853s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.672s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Creating offline snapshot 5f669872-70c1-4c24-8cf9-00434f60ddac of volume 34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a854b-c804-4b2f-9481-25ed0a2a08f8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b33131d0-260b-4d20-95b7-7f95ca198923 tempest-VolumesSnapshotTestJSON-425856056 None] Create snapshot completed successfully Jul 10 00:40:33 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b Jul 10 00:40:33 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (6e8b1d40-3bd7-4f19-9f48-46ac7af2cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e7e11a-fdce-47be-a143-57f59065418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e7e11a-fdce-47be-a143-57f59065418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287005296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b272883d-9901-4df3-a490-f812fdcb2ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:33Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04ad206-f977-4c69-b5ee-be55b37c7cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04ad206-f977-4c69-b5ee-be55b37c7cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939bc6b7-5025-45b7-bac9-54eec2f2c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939bc6b7-5025-45b7-bac9-54eec2f2c111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b272883d-9901-4df3-a490-f812fdcb2ae3', 'volume_name': 'volume-b272883d-9901-4df3-a490-f812fdcb2ae3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588b4d43-f9f9-4ad2-81cb-cfd79528ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588b4d43-f9f9-4ad2-81cb-cfd79528ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdfd2e6-493f-4cc4-9145-94a02a375bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:33 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Volume b272883d-9901-4df3-a490-f812fdcb2ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b272883d-9901-4df3-a490-f812fdcb2ae3', 'volume_size': 1} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-93a560c8-a089-4de2-bf33-3ea066f7eaaa-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-93a560c8-a089-4de2-bf33-3ea066f7eaaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-bae0acc1-4ebb-45ee-baae-e21675706cc3" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-bae0acc1-4ebb-45ee-baae-e21675706cc3" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-93a560c8-a089-4de2-bf33-3ea066f7eaaa" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-93a560c8-a089-4de2-bf33-3ea066f7eaaa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Deleting offline snapshot 93a560c8-a089-4de2-bf33-3ea066f7eaaa of volume bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] snapshot_file for this snap is: volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8326867a-3628-4772-abac-c66d5d14c82b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:33 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa Jul 10 00:40:33 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:33 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b" returned: 0 in 0.818s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:33 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac 1G Jul 10 00:40:33 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:34 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa" returned: 0 in 0.814s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae0acc1-4ebb-45ee-baae-e21675706cc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:40:34 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ee4505-3626-4cec-8059-7697b6e65e9a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:34 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 Jul 10 00:40:34 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:34 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac 1G" returned: 0 in 0.824s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ddb620-51bb-4d06-87c4-01d8df66665b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:34 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ddb620-51bb-4d06-87c4-01d8df66665b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac Jul 10 00:40:34 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:35 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3" returned: 0 in 0.771s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:35 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa Jul 10 00:40:35 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:35 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ddb620-51bb-4d06-87c4-01d8df66665b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac" returned: 0 in 0.681s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:35 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:35 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac Jul 10 00:40:35 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:35 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac" returned: 0 in 0.637s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:35 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa" returned: 0 in 0.775s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:35 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.info Jul 10 00:40:35 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:35 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa Jul 10 00:40:35 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:36 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3.93a560c8-a089-4de2-bf33-3ea066f7eaaa" returned: 0 in 0.636s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-93a560c8-a089-4de2-bf33-3ea066f7eaaa" released by "_delete_snapshot" :: held 3.101s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-bae0acc1-4ebb-45ee-baae-e21675706cc3" released by "delete_snapshot" :: held 3.126s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:36 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.info" returned: 0 in 0.722s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:36 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:40:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:36 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.info Jul 10 00:40:36 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:36 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['267bdfe2-ffb2-489a-b0ef-234eceac1e06', '10a3120f-72c2-4262-9122-541c593c9486', '4c6c51a7-a179-41e9-84cd-5cabb17c2e0e', '3858382c-a022-4ad9-af5d-13fd121923d1'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:36 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Delete snapshot completed successfully. Jul 10 00:40:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-37014c03-fd1d-417d-a881-621b6b95d1dd tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-93a560c8-a089-4de2-bf33-3ea066f7eaaa-delete_snapshot" released by "delete_snapshot" :: held 3.313s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:37 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.info" returned: 0 in 0.638s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.431s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Creating offline snapshot e77b72b5-e481-45c4-a250-653e2e2fdda9 of volume 97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:40:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e83e07-3692-4e5c-808a-bb40d6639ffa]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:37 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 Jul 10 00:40:37 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:38 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:38 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 1G Jul 10 00:40:38 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (e6f56acf-e5f3-4861-aa7d-805a00d02d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a788e54c-fd32-4f17-8a32-c84d9b4256b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a788e54c-fd32-4f17-8a32-c84d9b4256b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1879271003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0ee474-ebd5-4841-a57b-a912b5d084d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:38Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197488f-46d0-4967-9590-ef80a6e59975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197488f-46d0-4967-9590-ef80a6e59975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6adb9a4-771a-4121-8aef-77364817ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6adb9a4-771a-4121-8aef-77364817ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0ee474-ebd5-4841-a57b-a912b5d084d7', 'volume_name': 'volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea989fa-c163-4871-ab50-3ff012ba25a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea989fa-c163-4871-ab50-3ff012ba25a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e03285-1a17-42b5-a88b-fc231aa92d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:38 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Volume 7b0ee474-ebd5-4841-a57b-a912b5d084d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7', 'volume_size': 1} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:38 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 1G" returned: 0 in 0.868s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:38 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 Jul 10 00:40:38 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:39 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9" returned: 0 in 0.777s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:39 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:40:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:39 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 Jul 10 00:40:39 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:40 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9" returned: 0 in 0.669s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:40 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.info Jul 10 00:40:40 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:41 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.info" returned: 0 in 0.628s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:41 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:41 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.info Jul 10 00:40:41 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:41 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.info" returned: 0 in 0.628s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.395s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.536s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287005296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b272883d-9901-4df3-a490-f812fdcb2ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:33Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Creating volume b272883d-9901-4df3-a490-f812fdcb2ae3 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:41 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:41 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 1073741824 Jul 10 00:40:41 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a0a4d068-5afe-43ca-bc51-b8dc6b97d723 tempest-GroupSnapshotsTest-22687373 None] group_snapshot aaa3dfaf-67a8-4e02-b8c9-c1f68096c262: created successfully Jul 10 00:40:42 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 1073741824" returned: 0 in 0.854s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:42 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 Jul 10 00:40:42 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:42 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] group_snapshot aaa3dfaf-67a8-4e02-b8c9-c1f68096c262: deleting Jul 10 00:40:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] group_snapshot aaa3dfaf-67a8-4e02-b8c9-c1f68096c262: deleting {{(pid=87452) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-34ddb620-51bb-4d06-87c4-01d8df66665b" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-34ddb620-51bb-4d06-87c4-01d8df66665b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-5f669872-70c1-4c24-8cf9-00434f60ddac" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Flow 'volume_create_manager' (55fb1c67-1d1c-4eca-bccc-0102773762c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc3b227-9e90-4e77-b95f-1b991f80dce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-5f669872-70c1-4c24-8cf9-00434f60ddac" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Deleting offline snapshot 5f669872-70c1-4c24-8cf9-00434f60ddac of volume 34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] snapshot_file for this snap is: volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc3b227-9e90-4e77-b95f-1b991f80dce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-700374339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184f9d9d-138d-4aa4-bb50-499f0a44f850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed41c1d37374beea4b1a1adcb6441a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:43Z,use_quota=True,user_id='6147ad8eb41b4016b17a7810d2bb22c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff12567-e093-4b75-9e55-4448a07f3d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff12567-e093-4b75-9e55-4448a07f3d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e367bad4-f965-45e7-bc2e-1de859ba1be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e367bad4-f965-45e7-bc2e-1de859ba1be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184f9d9d-138d-4aa4-bb50-499f0a44f850', 'volume_name': 'volume-184f9d9d-138d-4aa4-bb50-499f0a44f850', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3423e73-6bbe-4c03-98e7-8361ee208bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3423e73-6bbe-4c03-98e7-8361ee208bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d38986e-b179-4e2f-986c-8de32b073280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:43 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Volume 184f9d9d-138d-4aa4-bb50-499f0a44f850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184f9d9d-138d-4aa4-bb50-499f0a44f850', 'volume_size': 1} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb92abe-2892-41e7-976e-9feb5adec2b3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:43 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac Jul 10 00:40:43 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:43 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3" returned: 0 in 0.769s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.025s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1879271003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0ee474-ebd5-4841-a57b-a912b5d084d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:38Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Creating volume 7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:43 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:43 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 1073741824 Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdfd2e6-493f-4cc4-9145-94a02a375bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b272883d-9901-4df3-a490-f812fdcb2ae3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:43 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53dab14-bebd-481e-9ee4-074d7cf342c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:43 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Volume volume-b272883d-9901-4df3-a490-f812fdcb2ae3 (b272883d-9901-4df3-a490-f812fdcb2ae3): created successfully Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53dab14-bebd-481e-9ee4-074d7cf342c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (6e8b1d40-3bd7-4f19-9f48-46ac7af2cab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:43 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a312fe57-42e0-432c-847e-b8991926d3ea tempest-ProjectReaderTests-1264609071 None] Created volume successfully. Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-b272883d-9901-4df3-a490-f812fdcb2ae3-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Lock "cinder-b272883d-9901-4df3-a490-f812fdcb2ae3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-quobyte-b272883d-9901-4df3-a490-f812fdcb2ae3" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-b272883d-9901-4df3-a490-f812fdcb2ae3" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ff8e3-de81-4715-93da-f2dc93d55844]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:44 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 Jul 10 00:40:44 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:44 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac" returned: 0 in 0.901s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34ddb620-51bb-4d06-87c4-01d8df66665b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56867f-7f6c-4117-a26d-fc624d9349c0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:44 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b Jul 10 00:40:44 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:44 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 1073741824" returned: 0 in 0.938s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:44 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 Jul 10 00:40:44 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:44 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3" returned: 0 in 0.837s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:44 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3 Jul 10 00:40:44 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:44 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b" returned: 0 in 0.784s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:44 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac Jul 10 00:40:44 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:45 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7" returned: 0 in 0.688s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-700374339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184f9d9d-138d-4aa4-bb50-499f0a44f850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed41c1d37374beea4b1a1adcb6441a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:43Z,use_quota=True,user_id='6147ad8eb41b4016b17a7810d2bb22c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Creating volume 184f9d9d-138d-4aa4-bb50-499f0a44f850 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:45 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:45 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 1073741824 Jul 10 00:40:45 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e03285-1a17-42b5-a88b-fc231aa92d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1546a72-2573-4df6-b10c-a369e9cffbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Volume volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 (7b0ee474-ebd5-4841-a57b-a912b5d084d7): created successfully Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1546a72-2573-4df6-b10c-a369e9cffbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (e6f56acf-e5f3-4861-aa7d-805a00d02d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c22cc741-219e-488b-9f55-bff71c1a24e9 tempest-VolumesSnapshotTestJSON-425856056 None] Created volume successfully. Jul 10 00:40:45 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b272883d-9901-4df3-a490-f812fdcb2ae3" returned: 0 in 0.758s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-b272883d-9901-4df3-a490-f812fdcb2ae3" released by "delete_volume" :: held 1.654s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Created reservations ['eecab8da-bcd5-4bf2-abce-91bf8bba4cb3', '47dd64fb-79a2-4740-96b7-3d3f34f2185c', 'da59a9cd-8a2e-4188-bff9-38c51bb937fa', 'eba03ba7-8222-4120-a3cb-fb98c2edae15'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:45 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:45 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:45 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac" returned: 0 in 0.865s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:45 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac Jul 10 00:40:45 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:46 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 1073741824" returned: 0 in 1.027s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:46 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 Jul 10 00:40:46 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:46 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.839s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:46 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Deleted volume successfully. Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2d20d80-d6fe-41bc-a22b-e51afc809dca tempest-ProjectReaderTests-1264609071 None] Lock "cinder-b272883d-9901-4df3-a490-f812fdcb2ae3-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:46 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b.5f669872-70c1-4c24-8cf9-00434f60ddac" returned: 0 in 0.834s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-5f669872-70c1-4c24-8cf9-00434f60ddac" released by "_delete_snapshot" :: held 3.533s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-34ddb620-51bb-4d06-87c4-01d8df66665b" released by "delete_snapshot" :: held 3.592s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (c623bc70-a857-43af-a452-ab48313a2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c294cdfe-6932-4f1a-b194-07c8d9331eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-97f74f30-9ed4-489e-a8d0-624e1949bae7" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c294cdfe-6932-4f1a-b194-07c8d9331eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903871593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b0078b-966d-4696-b762-980b09a3c68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:47Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db579c11-75af-4b21-907d-cec3d56689ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db579c11-75af-4b21-907d-cec3d56689ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c432341-e244-4b06-871f-bb84f07cf060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c432341-e244-4b06-871f-bb84f07cf060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b0078b-966d-4696-b762-980b09a3c68d', 'volume_name': 'volume-74b0078b-966d-4696-b762-980b09a3c68d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be16a7fc-0db3-4ce5-a315-e90a607da346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be16a7fc-0db3-4ce5-a315-e90a607da346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c50d4a4-a9a5-4102-b633-9416099f0279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Volume 74b0078b-966d-4696-b762-980b09a3c68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b0078b-966d-4696-b762-980b09a3c68d', 'volume_size': 1} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-97f74f30-9ed4-489e-a8d0-624e1949bae7" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-e77b72b5-e481-45c4-a250-653e2e2fdda9" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-e77b72b5-e481-45c4-a250-653e2e2fdda9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Deleting offline snapshot e77b72b5-e481-45c4-a250-653e2e2fdda9 of volume 97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] snapshot_file for this snap is: volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e1bc2-08a8-4910-9117-7254ffba3ef7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:46 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 Jul 10 00:40:46 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:46 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850" returned: 0 in 0.834s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.038s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Creating offline snapshot 398a5b4c-ff31-4150-9e5b-b096641ddd62 of volume 7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d38986e-b179-4e2f-986c-8de32b073280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184f9d9d-138d-4aa4-bb50-499f0a44f850', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdb4168-a9e6-41aa-b8e8-4da61b76ad13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a67e11-f807-4412-9281-6df3c5b7dd9e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:47 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Volume volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 (184f9d9d-138d-4aa4-bb50-499f0a44f850): created successfully Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdb4168-a9e6-41aa-b8e8-4da61b76ad13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Flow 'volume_create_manager' (55fb1c67-1d1c-4eca-bccc-0102773762c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-846ba8c2-62fe-4edb-9983-f1dbbebf28e1 tempest-AttachVolumeNegativeTest-1182203413 None] Created volume successfully. Jul 10 00:40:47 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 Jul 10 00:40:47 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:47 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9" returned: 0 in 0.792s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97f74f30-9ed4-489e-a8d0-624e1949bae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[560292ef-a769-4ff7-bc26-6f81f348300f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:47 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 Jul 10 00:40:47 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:47 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7" returned: 0 in 0.810s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:47 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 1G Jul 10 00:40:47 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:48 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7" returned: 0 in 0.772s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:48 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 Jul 10 00:40:48 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:48 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 1G" returned: 0 in 0.879s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:48 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 Jul 10 00:40:48 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:49 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9" returned: 0 in 0.824s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:49 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9 Jul 10 00:40:49 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:49 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62" returned: 0 in 0.698s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:49 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 is being set with open permissions: ugo+rw Jul 10 00:40:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:49 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 Jul 10 00:40:49 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:49 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7.e77b72b5-e481-45c4-a250-653e2e2fdda9" returned: 0 in 0.690s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-e77b72b5-e481-45c4-a250-653e2e2fdda9" released by "_delete_snapshot" :: held 3.202s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-97f74f30-9ed4-489e-a8d0-624e1949bae7" released by "delete_snapshot" :: held 3.228s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:50 devstack cinder-volume[87452]: WARNING cinder.quota [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-903044376 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-903044376, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:40:50 devstack cinder-volume[87452]: WARNING cinder.quota [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-903044376 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-903044376, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:40:50 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['2d1aeecb-0bfe-47fc-851a-8e66043917e1', 'c955d5ac-9e60-4218-83ae-66fd5e76cb3d', 'a443a1e8-d2f1-4f49-a151-e2a0ec815cf6', '0482bb8d-4750-4988-a52d-f93f015f057a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:50 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62" returned: 0 in 0.749s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:50 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.info Jul 10 00:40:50 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:50 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['0d4f2d31-737e-4647-ad57-b212955340ac', '96f4770d-695f-4c97-b205-9abda86ff154', '7103013b-1708-4b7f-9055-7b9cd3b0eab0', '0aa89c7a-9a20-404e-9d15-c82dd43fb456'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:50 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8cc8e1ca-d318-4457-9156-a6f738a34b90 tempest-GroupSnapshotsTest-22687373 None] group_snapshot aaa3dfaf-67a8-4e02-b8c9-c1f68096c262: deleted successfully Jul 10 00:40:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ba893bc1-9712-472b-b30f-5de0ee04f361 req-2476cf1c-3875-49b9-90bb-daafde639ff4 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:50 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.info" returned: 0 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:51 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.info is being set with open permissions: ugo+rw Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:51 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.info Jul 10 00:40:51 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-34ddb620-51bb-4d06-87c4-01d8df66665b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-34ddb620-51bb-4d06-87c4-01d8df66665b" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e59ef6f-be3c-442d-82dc-b45f3b2d1270]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:51 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b Jul 10 00:40:51 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:51 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.info" returned: 0 in 0.699s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.761s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.979s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903871593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b0078b-966d-4696-b762-980b09a3c68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:47Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Creating volume 74b0078b-966d-4696-b762-980b09a3c68d {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:51 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:40:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:51 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d 1073741824 Jul 10 00:40:51 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-501b2f5a-83ad-4f94-8aff-56de56f54884 tempest-VolumesSnapshotTestJSON-425856056 None] Create snapshot completed successfully Jul 10 00:40:52 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b" returned: 0 in 0.829s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:52 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b Jul 10 00:40:52 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:52 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d 1073741824" returned: 0 in 0.855s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:52 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d Jul 10 00:40:52 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:52 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-34ddb620-51bb-4d06-87c4-01d8df66665b" returned: 0 in 0.690s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-34ddb620-51bb-4d06-87c4-01d8df66665b" released by "delete_volume" :: held 1.619s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-97f74f30-9ed4-489e-a8d0-624e1949bae7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-97f74f30-9ed4-489e-a8d0-624e1949bae7" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6faedb-881d-4b11-997e-0122a4229cd2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (b5abdca6-8d0b-4f2a-8bd2-f38b5727f3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e96cc1-6726-4fad-828d-524896b3c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 Jul 10 00:40:52 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e96cc1-6726-4fad-828d-524896b3c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-966432815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d32bbe-61ab-4d15-b0f7-6c8fa6369820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=398a5b4c-ff31-4150-9e5b-b096641ddd62,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:53Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995797d1-b8f9-4956-9faf-50a850499125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995797d1-b8f9-4956-9faf-50a850499125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e449f9-5c42-4843-ba5d-777eefab67bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e449f9-5c42-4843-ba5d-777eefab67bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08d32bbe-61ab-4d15-b0f7-6c8fa6369820', 'volume_name': 'volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820', 'volume_size': 2, 'snapshot_id': '398a5b4c-ff31-4150-9e5b-b096641ddd62'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d22552-7362-40a6-a8b8-a2c7076111cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d22552-7362-40a6-a8b8-a2c7076111cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14936ebd-9ecb-4f58-831c-5a2d34db68e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Volume 08d32bbe-61ab-4d15-b0f7-6c8fa6369820: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820', 'volume_size': 2, 'snapshot_id': '398a5b4c-ff31-4150-9e5b-b096641ddd62'} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:53 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ba893bc1-9712-472b-b30f-5de0ee04f361 req-2476cf1c-3875-49b9-90bb-daafde639ff4 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c50d4a4-a9a5-4102-b633-9416099f0279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b0078b-966d-4696-b762-980b09a3c68d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff043ca-ae34-4961-ad95-8ef1ff1f6740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a257006c-f414-4c9a-916c-4300f93861d4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ba893bc1-9712-472b-b30f-5de0ee04f361 req-2476cf1c-3875-49b9-90bb-daafde639ff4 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Volume volume-74b0078b-966d-4696-b762-980b09a3c68d (74b0078b-966d-4696-b762-980b09a3c68d): created successfully Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff043ca-ae34-4961-ad95-8ef1ff1f6740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (c623bc70-a857-43af-a452-ab48313a2d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:53 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8ce9d74f-2f25-4e8b-a163-fb1afcb7976b tempest-ProjectReaderTests-1264609071 None] Created volume successfully. Jul 10 00:40:53 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 Jul 10 00:40:53 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:53 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:53 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:53 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7" returned: 0 in 0.807s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:53 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7 Jul 10 00:40:53 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:54 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ba893bc1-9712-472b-b30f-5de0ee04f361 req-2476cf1c-3875-49b9-90bb-daafde639ff4 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850" returned: 0 in 0.826s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ba893bc1-9712-472b-b30f-5de0ee04f361 req-2476cf1c-3875-49b9-90bb-daafde639ff4 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.150s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-398a5b4c-ff31-4150-9e5b-b096641ddd62-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-398a5b4c-ff31-4150-9e5b-b096641ddd62-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Creating volume 08d32bbe-61ab-4d15-b0f7-6c8fa6369820 from snapshot 398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] snapshot: 398a5b4c-ff31-4150-9e5b-b096641ddd62, volume: 08d32bbe-61ab-4d15-b0f7-6c8fa6369820, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ba893bc1-9712-472b-b30f-5de0ee04f361 req-2476cf1c-3875-49b9-90bb-daafde639ff4 tempest-AttachVolumeNegativeTest-1182203413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-184f9d9d-138d-4aa4-bb50-499f0a44f850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a2b85f1-3f62-4395-8b83-6ea2e20a5d19', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:40:54 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-74b0078b-966d-4696-b762-980b09a3c68d-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.765s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Lock "cinder-74b0078b-966d-4696-b762-980b09a3c68d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028468e-adf6-4ecd-85b5-5255efca687d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:54 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97f74f30-9ed4-489e-a8d0-624e1949bae7" returned: 0 in 0.760s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-97f74f30-9ed4-489e-a8d0-624e1949bae7" released by "delete_volume" :: held 1.651s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-quobyte-74b0078b-966d-4696-b762-980b09a3c68d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:54 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 Jul 10 00:40:54 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:54 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-ba893bc1-9712-472b-b30f-5de0ee04f361 req-2476cf1c-3875-49b9-90bb-daafde639ff4 tempest-AttachVolumeNegativeTest-1182203413 None] attachment_update completed successfully. Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-74b0078b-966d-4696-b762-980b09a3c68d" acquired by "delete_volume" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a630bdba-bf02-41c2-84d4-edb42eba145b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['dc481949-073a-4725-b23e-52674ca1580a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:54 devstack cinder-volume[87452]: WARNING cinder.quota [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-903044376 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-903044376, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['7378d4f0-282f-4446-9c94-3621f0a97128', '6c026d32-5e28-4985-b27f-29a4b1972df4', '56db345b-d74b-4bab-a044-78696a1d5f63', 'e9568d4b-5367-4777-9288-a55fb2b93426'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:54 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d Jul 10 00:40:54 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['b82baa6f-ee79-46d1-a297-042019a16efc', '402cd876-66fa-4a1f-84e3-8eea561c6810', 'd3e8d013-e0b5-43dc-9e0f-bd2a293902b9', 'deb3e929-16f9-4c42-bb44-be21e398806c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:54 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:54 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:55 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62" returned: 0 in 0.934s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[889b794f-81c7-4ccd-a6ee-c41d85e8f778]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:55 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 Jul 10 00:40:55 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:55 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d" returned: 0 in 1.225s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-97996020-a182-4b87-97e3-cdc63044ba1f tempest-GroupSnapshotsTest-22687373 None] Group tempest-GroupSnapshotsTest-Group-1768311976: creating Jul 10 00:40:55 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d Jul 10 00:40:55 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-97996020-a182-4b87-97e3-cdc63044ba1f tempest-GroupSnapshotsTest-22687373 None] Group tempest-GroupSnapshotsTest-Group-1768311976: created successfully Jul 10 00:40:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-97996020-a182-4b87-97e3-cdc63044ba1f tempest-GroupSnapshotsTest-22687373 None] Create group completed successfully. Jul 10 00:40:55 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.028s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:55 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-03b1dc28-0288-41bd-9ad2-242c3da38cb9 tempest-GroupSnapshotsTest-22687373 None] Delete group completed successfully. Jul 10 00:40:56 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7" returned: 0 in 0.950s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:56 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 Jul 10 00:40:56 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:56 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-74b0078b-966d-4696-b762-980b09a3c68d" returned: 0 in 0.680s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-74b0078b-966d-4696-b762-980b09a3c68d" released by "delete_volume" :: held 1.951s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Created reservations ['50b0f984-2dba-4206-823f-90dcca6262c5', 'bd647692-0ad4-48d6-b9d3-221da71964b2', '1c1e291c-df5e-4e22-a6d3-379d259701c0', '594d7421-28b0-41bc-b047-1f0380299b2f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:56 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:40:56 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (fb722fde-d9e4-4a92-8f6f-897857b48862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3487838a-5c52-4165-94f8-f345b8367b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3487838a-5c52-4165-94f8-f345b8367b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998080680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f59786f-7941-4621-930d-943915a20365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:57Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b044ee13-4adf-48b6-a2d7-a045b1e9fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b044ee13-4adf-48b6-a2d7-a045b1e9fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f6f743-6b77-485a-af04-f77af27f78a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f6f743-6b77-485a-af04-f77af27f78a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f59786f-7941-4621-930d-943915a20365', 'volume_name': 'volume-5f59786f-7941-4621-930d-943915a20365', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97505816-2a2a-4ee0-a522-0556c3652f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97505816-2a2a-4ee0-a522-0556c3652f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c471fea0-5031-4ea6-b16a-51b7e48d52bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:57 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Volume 5f59786f-7941-4621-930d-943915a20365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f59786f-7941-4621-930d-943915a20365', 'volume_size': 1} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:57 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.832s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Deleted volume successfully. Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-841b96a5-0fd4-4ef9-a996-36e0e77e2e8e tempest-ProjectReaderTests-1264609071 None] Lock "cinder-74b0078b-966d-4696-b762-980b09a3c68d-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (833d4f8f-32b6-4f03-ae6a-b168403fc8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e461fb52-229e-48f8-9b54-3b0d94300107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e461fb52-229e-48f8-9b54-3b0d94300107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703052303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6d30508-aadb-4764-8bc0-90a81aac3fe2,host='devstack@QuobyteHD#QuobyteHD',id=d3fdc56f-ec25-45fe-96e9-e782cdea99fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:58Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8c97ca5-cb28-4861-af87-d2f0ca7c8531),volume_type_id=d8c97ca5-cb28-4861-af87-d2f0ca7c8531)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae99a0e-d793-40ed-8420-9a72bb0023b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae99a0e-d793-40ed-8420-9a72bb0023b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c61aed-f624-4340-b1fc-65f5f95823dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c61aed-f624-4340-b1fc-65f5f95823dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3fdc56f-ec25-45fe-96e9-e782cdea99fb', 'volume_name': 'volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfbd42a-f9a4-482f-a332-3704369f0dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfbd42a-f9a4-482f-a332-3704369f0dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd6080c-ba94-4bed-9251-3f1ea8ec0a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Volume d3fdc56f-ec25-45fe-96e9-e782cdea99fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb', 'volume_size': 1} Jul 10 00:40:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:02 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" returned: 0 in 5.896s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[867c9e8c-cb00-4279-81a0-aaa2d1c945e0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:02 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 Jul 10 00:41:02 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:03 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7" returned: 0 in 0.985s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:41:03 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Converted 1024.00 MB image at 173.64 MB/s Jul 10 00:41:03 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 is being set with open permissions: ugo+rw Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:03 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 Jul 10 00:41:03 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:03 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" returned: 0 in 0.664s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" released by "_copy_volume_from_snapshot" :: held 9.602s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-398a5b4c-ff31-4150-9e5b-b096641ddd62-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" released by "_create_volume_from_snapshot" :: held 9.646s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.679s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.572s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998080680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f59786f-7941-4621-930d-943915a20365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:57Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Creating volume 5f59786f-7941-4621-930d-943915a20365 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:03 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:03 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 1073741824 Jul 10 00:41:03 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14936ebd-9ecb-4f58-831c-5a2d34db68e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820', 'volume_size': 2, 'snapshot_id': '398a5b4c-ff31-4150-9e5b-b096641ddd62'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242172e5-e79c-4625-82dd-1c8909b35e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Volume volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 (08d32bbe-61ab-4d15-b0f7-6c8fa6369820): created successfully Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242172e5-e79c-4625-82dd-1c8909b35e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (b5abdca6-8d0b-4f2a-8bd2-f38b5727f3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-149fed3f-6880-445d-927f-246e4f964055 tempest-VolumesSnapshotTestJSON-425856056 None] Created volume successfully. Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-08d32bbe-61ab-4d15-b0f7-6c8fa6369820-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-08d32bbe-61ab-4d15-b0f7-6c8fa6369820-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c9c5d-d94a-4250-81b7-5e3839f60f3d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:04 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 Jul 10 00:41:04 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:04 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 1073741824" returned: 0 in 1.019s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:04 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 Jul 10 00:41:04 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:05 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" returned: 0 in 0.842s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:05 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820 Jul 10 00:41:05 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:05 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365" returned: 0 in 0.687s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.436s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d6d30508-aadb-4764-8bc0-90a81aac3fe2,created_at=2026-07-09T22:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1703052303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6d30508-aadb-4764-8bc0-90a81aac3fe2,host='devstack@QuobyteHD#QuobyteHD',id=d3fdc56f-ec25-45fe-96e9-e782cdea99fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e69a94ac814b8c87b246befcbce80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:58Z,use_quota=True,user_id='4c950332634148d9b94a35f81597e29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8c97ca5-cb28-4861-af87-d2f0ca7c8531),volume_type_id=d8c97ca5-cb28-4861-af87-d2f0ca7c8531)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Creating volume d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:05 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c471fea0-5031-4ea6-b16a-51b7e48d52bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f59786f-7941-4621-930d-943915a20365', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:05 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb 1073741824 Jul 10 00:41:05 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ee7f37-d764-45bd-bf9a-35ce66f5409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:05 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Volume volume-5f59786f-7941-4621-930d-943915a20365 (5f59786f-7941-4621-930d-943915a20365): created successfully Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ee7f37-d764-45bd-bf9a-35ce66f5409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (fb722fde-d9e4-4a92-8f6f-897857b48862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f9b1e912-a07e-42ba-b3fb-2d4278a504a9 tempest-ProjectReaderTests-1264609071 None] Created volume successfully. Jul 10 00:41:05 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" returned: 0 in 0.693s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-08d32bbe-61ab-4d15-b0f7-6c8fa6369820" released by "delete_volume" :: held 1.598s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['86b4395a-a0f8-4cdd-9ea2-877800c24959', 'c03c0447-f33a-44d4-9755-7b342146ec2a', '5c8a50ea-a100-4947-b305-5ff7c0d2041d', '39cd778d-6256-4d72-90dc-85b67f09ade9'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:06 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:06 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-5f59786f-7941-4621-930d-943915a20365-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Lock "cinder-5f59786f-7941-4621-930d-943915a20365-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-quobyte-5f59786f-7941-4621-930d-943915a20365" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-5f59786f-7941-4621-930d-943915a20365" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae94d14-151e-4311-ba28-3c3deaf5a422]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:06 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 Jul 10 00:41:06 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-398a5b4c-ff31-4150-9e5b-b096641ddd62-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-398a5b4c-ff31-4150-9e5b-b096641ddd62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-7b0ee474-ebd5-4841-a57b-a912b5d084d7" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-7b0ee474-ebd5-4841-a57b-a912b5d084d7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-398a5b4c-ff31-4150-9e5b-b096641ddd62" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-398a5b4c-ff31-4150-9e5b-b096641ddd62" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Deleting offline snapshot 398a5b4c-ff31-4150-9e5b-b096641ddd62 of volume 7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:41:06 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] snapshot_file for this snap is: volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb 1073741824" returned: 0 in 1.081s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2141ec2-6abf-4a25-9a9b-d67021e10007]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:06 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:06 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb Jul 10 00:41:06 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.780s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Deleted volume successfully. Jul 10 00:41:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-830bd4f7-7cfe-4254-960f-85e7eab2053f tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-08d32bbe-61ab-4d15-b0f7-6c8fa6369820-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:06 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 Jul 10 00:41:06 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:07 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365" returned: 0 in 1.039s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:07 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365 Jul 10 00:41:07 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:07 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" returned: 0 in 0.808s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd6080c-ba94-4bed-9251-3f1ea8ec0a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e3f98d-534d-4e34-8dde-a2aba6dba036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:07 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62" returned: 0 in 0.925s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:41:07 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Volume volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb (d3fdc56f-ec25-45fe-96e9-e782cdea99fb): created successfully Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e3f98d-534d-4e34-8dde-a2aba6dba036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Flow 'volume_create_manager' (833d4f8f-32b6-4f03-ae6a-b168403fc8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1acca2-6fc5-482c-956f-c719ef81075e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-651ad530-e426-404c-963a-7182c56dc29a tempest-GroupSnapshotsTest-22687373 None] Created volume successfully. Jul 10 00:41:07 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 Jul 10 00:41:07 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:08 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5f59786f-7941-4621-930d-943915a20365" returned: 0 in 0.740s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-5f59786f-7941-4621-930d-943915a20365" released by "delete_volume" :: held 1.832s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Created reservations ['ac927d6b-57c6-4add-a663-f6a49de622ca', '0cb43a6b-1927-4f48-ae81-1039c975d69a', 'f7399692-3743-4f39-84a5-1b8afc89ad2c', '94975281-8bf6-4dfa-8482-0c014ba88c8f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:08 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:08 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] GroupSnapshot 3de326ff-8d55-4399-a4a9-19afb7acf441: creating. Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Group snapshot 3de326ff-8d55-4399-a4a9-19afb7acf441: creating. {{(pid=87452) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Creating offline snapshot 93119950-6e6c-46a3-a1b4-95ff879e7e1a of volume d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e929197-8711-43b6-b3ba-a6f97245b97d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:08 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7" returned: 0 in 1.093s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:08 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 Jul 10 00:41:08 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:08 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb Jul 10 00:41:08 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (5f371c2c-5d53-450a-b22a-be6c57a1d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949ca29c-9f69-4db4-b865-fcc1c7ea1e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949ca29c-9f69-4db4-b865-fcc1c7ea1e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858088609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3adff4-7ded-41bd-8bc8-b5b65a55a981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:09Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489b832-4944-4396-8368-48606cd2f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489b832-4944-4396-8368-48606cd2f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba39e1a-15ae-4478-a740-4c0ff3b284d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba39e1a-15ae-4478-a740-4c0ff3b284d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3adff4-7ded-41bd-8bc8-b5b65a55a981', 'volume_name': 'volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1202fb-f89d-4102-8011-e384040c9eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1202fb-f89d-4102-8011-e384040c9eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e04743-5b9d-437d-91d7-c6a33b47e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:09 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Volume 2b3adff4-7ded-41bd-8bc8-b5b65a55a981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981', 'volume_size': 1} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:09 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.332s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Deleted volume successfully. Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b360878-031e-4a59-bcee-b3961dffc6fb tempest-ProjectReaderTests-1264609071 None] Lock "cinder-5f59786f-7941-4621-930d-943915a20365-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:09 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" returned: 0 in 1.134s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:09 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62" returned: 0 in 1.124s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:09 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a 1G Jul 10 00:41:09 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:09 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62 Jul 10 00:41:09 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:10 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7.398a5b4c-ff31-4150-9e5b-b096641ddd62" returned: 0 in 0.973s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-398a5b4c-ff31-4150-9e5b-b096641ddd62" released by "_delete_snapshot" :: held 4.274s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-7b0ee474-ebd5-4841-a57b-a912b5d084d7" released by "delete_snapshot" :: held 4.313s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:11 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a 1G" returned: 0 in 1.104s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:11 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a Jul 10 00:41:11 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:11 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['f6cb63c9-0b12-46ac-a0e9-b76acca954c0', '5f442777-fec0-46b0-bc3a-862bc78c0764', 'aeddc3d9-6c59-4c7e-9e18-f8a57b8d5583', '51c536f2-8c11-4c66-a39d-07ec69500032'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Delete snapshot completed successfully. Jul 10 00:41:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6f99adff-6b11-4168-9cd3-54473e3cd759 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-398a5b4c-ff31-4150-9e5b-b096641ddd62-delete_snapshot" released by "delete_snapshot" :: held 4.507s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:11 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a" returned: 0 in 0.779s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:11 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:41:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:11 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a Jul 10 00:41:11 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-7b0ee474-ebd5-4841-a57b-a912b5d084d7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-7b0ee474-ebd5-4841-a57b-a912b5d084d7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-7b0ee474-ebd5-4841-a57b-a912b5d084d7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-7b0ee474-ebd5-4841-a57b-a912b5d084d7" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[968c3aec-776b-4043-a6a8-a0df74fe414e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:12 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 Jul 10 00:41:12 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:12 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a" returned: 0 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:12 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.info Jul 10 00:41:12 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:13 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7" returned: 0 in 0.816s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:13 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7 Jul 10 00:41:13 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:13 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.info" returned: 0 in 0.731s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:13 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:13 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.info Jul 10 00:41:13 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:13 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7b0ee474-ebd5-4841-a57b-a912b5d084d7" returned: 0 in 0.688s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-7b0ee474-ebd5-4841-a57b-a912b5d084d7" released by "delete_volume" :: held 1.579s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['b4bc6b07-94cb-4775-ba32-13f1dca86803', '68e1ec96-0a0c-44f9-89ac-29c9ac52c820', 'ca8b68da-54db-4bc0-8f6d-27a721ed2234', '874a3be7-9449-4ed1-ab1e-f0f8a14df1b1'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:13 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:13 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:14 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.info" returned: 0 in 0.680s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.318s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.494s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858088609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3adff4-7ded-41bd-8bc8-b5b65a55a981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1490c6c95d43d3951ef9dfbe1812d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:09Z,use_quota=True,user_id='2a687f0bd06448888f5668d593af0d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Creating volume 2b3adff4-7ded-41bd-8bc8-b5b65a55a981 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:14 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:14 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 1073741824 Jul 10 00:41:14 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-03af6e5b-612b-4108-be04-a36637c7cc56 tempest-GroupSnapshotsTest-22687373 None] group_snapshot 3de326ff-8d55-4399-a4a9-19afb7acf441: created successfully Jul 10 00:41:14 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.706s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Deleted volume successfully. Jul 10 00:41:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-87ba9690-5ce1-4f7b-aa2c-c1e275737192 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-7b0ee474-ebd5-4841-a57b-a912b5d084d7-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (9f6b05f2-e53e-49c3-927a-92682e9125ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:15 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0666d6f-e97b-416c-883e-6a6bb667ab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 1073741824" returned: 0 in 1.292s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0666d6f-e97b-416c-883e-6a6bb667ab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1731783982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f17104-82d1-4515-bbc3-020498bb8351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:15Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83edad50-47b1-4805-ad3d-7b75b2918d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83edad50-47b1-4805-ad3d-7b75b2918d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f898e12f-c501-4bdc-9b12-2c46d76d7cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f898e12f-c501-4bdc-9b12-2c46d76d7cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f17104-82d1-4515-bbc3-020498bb8351', 'volume_name': 'volume-c9f17104-82d1-4515-bbc3-020498bb8351', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d97f2e-db5d-4021-b257-b806f1fa4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d97f2e-db5d-4021-b257-b806f1fa4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f30c54-4120-4ab4-a96f-b02c2b563da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:15 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Volume c9f17104-82d1-4515-bbc3-020498bb8351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f17104-82d1-4515-bbc3-020498bb8351', 'volume_size': 1} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:15 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] group_snapshot 3de326ff-8d55-4399-a4a9-19afb7acf441: deleting Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] group_snapshot 3de326ff-8d55-4399-a4a9-19afb7acf441: deleting {{(pid=87452) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:15 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:15 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-93119950-6e6c-46a3-a1b4-95ff879e7e1a" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-93119950-6e6c-46a3-a1b4-95ff879e7e1a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Deleting offline snapshot 93119950-6e6c-46a3-a1b4-95ff879e7e1a of volume d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] snapshot_file for this snap is: volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[96861cad-9741-484a-bc05-bb4dae10d70f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:15 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a Jul 10 00:41:15 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:16 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981" returned: 0 in 0.858s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1731783982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f17104-82d1-4515-bbc3-020498bb8351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:15Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Creating volume c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:16 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:16 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 1073741824 Jul 10 00:41:16 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e04743-5b9d-437d-91d7-c6a33b47e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5813f937-8876-40a7-bb60-85c672c0a0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:16 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Volume volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 (2b3adff4-7ded-41bd-8bc8-b5b65a55a981): created successfully Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5813f937-8876-40a7-bb60-85c672c0a0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Flow 'volume_create_manager' (5f371c2c-5d53-450a-b22a-be6c57a1d77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-359b3034-289f-4294-a1db-8ee4270210b6 tempest-ProjectReaderTests-1264609071 None] Created volume successfully. Jul 10 00:41:16 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a" returned: 0 in 0.960s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda4f0e-7988-45b0-8b1b-be6a9d6369db]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-2b3adff4-7ded-41bd-8bc8-b5b65a55a981-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Lock "cinder-2b3adff4-7ded-41bd-8bc8-b5b65a55a981-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:16 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb Jul 10 00:41:16 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Acquiring lock "cinder-quobyte-2b3adff4-7ded-41bd-8bc8-b5b65a55a981" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-2b3adff4-7ded-41bd-8bc8-b5b65a55a981" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:17 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab98025-cdaa-4375-8c7a-e5fed2be5ec4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:17 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 Jul 10 00:41:17 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:17 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 1073741824" returned: 0 in 1.419s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:17 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 Jul 10 00:41:17 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:18 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" returned: 0 in 1.282s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:18 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a Jul 10 00:41:18 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:18 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981" returned: 0 in 1.576s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:18 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981 Jul 10 00:41:18 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:18 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351" returned: 0 in 1.010s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] <== create_volume: return (2515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.520s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f30c54-4120-4ab4-a96f-b02c2b563da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f17104-82d1-4515-bbc3-020498bb8351', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c91f0e3-183b-4306-8e44-85d6045227d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Volume volume-c9f17104-82d1-4515-bbc3-020498bb8351 (c9f17104-82d1-4515-bbc3-020498bb8351): created successfully Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c91f0e3-183b-4306-8e44-85d6045227d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (9f6b05f2-e53e-49c3-927a-92682e9125ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3c257e6e-6285-4fd9-b58a-43fe923aacb3 tempest-VolumesSnapshotTestJSON-425856056 None] Created volume successfully. Jul 10 00:41:19 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a" returned: 0 in 1.435s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:19 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a Jul 10 00:41:19 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:19 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2b3adff4-7ded-41bd-8bc8-b5b65a55a981" returned: 0 in 1.169s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Lock "cinder-quobyte-2b3adff4-7ded-41bd-8bc8-b5b65a55a981" released by "delete_volume" :: held 2.860s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Creating offline snapshot 0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 of volume c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[14460e4c-7a33-4b35-8ed3-1209c0f9735d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Created reservations ['70d8f96d-e88d-4b7e-bdbe-4f14a54b91e5', '43d0901e-3403-4336-a09d-40900e93a0d8', '34ad7cb4-7dc5-400f-818c-f25e5c9b51d9', '9357c510-c463-492e-9bac-496f8624ffd9'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:20 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 Jul 10 00:41:20 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:20 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:20 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:20 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb.93119950-6e6c-46a3-a1b4-95ff879e7e1a" returned: 0 in 1.324s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-93119950-6e6c-46a3-a1b4-95ff879e7e1a" released by "_delete_snapshot" :: held 5.273s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" released by "delete_snapshot" :: held 5.347s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:21 devstack cinder-volume[87452]: WARNING cinder.quota [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1043370545 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1043370545, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:41:21 devstack cinder-volume[87452]: WARNING cinder.quota [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1043370545 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1043370545, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:41:21 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['8b5195c4-333a-4490-94d9-cbcfcde364dd', '5ece19c9-3552-4e71-912e-3ca00a987485', '5fd95fb1-b5fd-4275-9f7c-c0f6bf5c11b4', '59f1345d-81e5-4926-82f7-518616ca96d2'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4fefa377-fe60-4000-b308-d8874547eef5 tempest-GroupSnapshotsTest-22687373 None] group_snapshot 3de326ff-8d55-4399-a4a9-19afb7acf441: deleted successfully Jul 10 00:41:21 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.458s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:21 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Deleted volume successfully. Jul 10 00:41:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-551bef05-c3b5-4b52-aec1-ab112e5a75ad tempest-ProjectReaderTests-1264609071 None] Lock "cinder-2b3adff4-7ded-41bd-8bc8-b5b65a55a981-delete_volume" released by "delete_volume" :: held 4.886s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:22 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351" returned: 0 in 1.989s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:22 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 1G Jul 10 00:41:22 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:22 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=140,cinder:INSERT=35,cinder:UPDATE=153,cinder:DELETE=8 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:41:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "cinder-quobyte-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5b9a2e-c7c0-4101-bca1-7670ec4c3a36]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:22 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb Jul 10 00:41:22 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:23 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 1G" returned: 0 in 1.309s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f17104-82d1-4515-bbc3-020498bb8351 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:23 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f17104-82d1-4515-bbc3-020498bb8351 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 Jul 10 00:41:23 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:24 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" returned: 0 in 1.410s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:24 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb Jul 10 00:41:24 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:24 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f17104-82d1-4515-bbc3-020498bb8351 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" returned: 0 in 0.970s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:24 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 is being set with open permissions: ugo+rw Jul 10 00:41:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:24 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 Jul 10 00:41:24 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:24 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" returned: 0 in 0.769s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Lock "cinder-quobyte-d3fdc56f-ec25-45fe-96e9-e782cdea99fb" released by "delete_volume" :: held 2.279s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=134,cinder:UPDATE=139,cinder:DELETE=11,cinder:INSERT=35 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['9f1cecfb-8db9-4d00-8455-b8a771fe5a69'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:25 devstack cinder-volume[87452]: WARNING cinder.quota [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1043370545 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1043370545, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:41:25 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Created reservations ['ba8976b9-7a7a-4538-b622-1bfd504fbedc', 'c64dd3fb-dda4-4e1c-8254-066b99f92b57', '4ae60813-c8ba-454f-9088-a6fd0f755f53', '459643d9-a8bf-4d9b-84a9-2d5c597afc32'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" returned: 0 in 0.975s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:25 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.info Jul 10 00:41:25 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:25 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:25 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:26 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.info" returned: 0 in 0.904s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:26 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.info is being set with open permissions: ugo+rw Jul 10 00:41:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:26 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.info Jul 10 00:41:26 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:26 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.878s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:26 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b6419b85-1b7e-4b1b-a729-9074da7b6538 tempest-GroupSnapshotsTest-22687373 None] Delete group completed successfully. Jul 10 00:41:27 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.info" returned: 0 in 1.005s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.391s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6db4b029-6888-4446-b41c-84bae148979c tempest-VolumesSnapshotTestJSON-425856056 None] Create snapshot completed successfully Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (255e0295-4e48-4a87-958e-f225d6e7dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258b868c-832f-4453-b8d2-e4fe3982fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258b868c-832f-4453-b8d2-e4fe3982fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1625944183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5715a46-2d59-41e9-be7a-ea06000f72a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4690c4d3cf41c783c3a353a2c81b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0bb105d4-0746-4d2f-8e1c-b1eab38e21e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:29Z,use_quota=True,user_id='af22cc9dc0c14251a79217e4e20f7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d9df63-633c-4975-aacb-accaae70ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d9df63-633c-4975-aacb-accaae70ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58173c1a-cdab-481a-adbb-f7bfa2672573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58173c1a-cdab-481a-adbb-f7bfa2672573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5715a46-2d59-41e9-be7a-ea06000f72a7', 'volume_name': 'volume-b5715a46-2d59-41e9-be7a-ea06000f72a7', 'volume_size': 1, 'snapshot_id': '0bb105d4-0746-4d2f-8e1c-b1eab38e21e4'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a14c2e6-9be0-43b7-8160-726419b1cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a14c2e6-9be0-43b7-8160-726419b1cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d391e1-8b6c-496f-8ad9-aeb8e47d9192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Volume b5715a46-2d59-41e9-be7a-ea06000f72a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5715a46-2d59-41e9-be7a-ea06000f72a7', 'volume_size': 1, 'snapshot_id': '0bb105d4-0746-4d2f-8e1c-b1eab38e21e4'} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4-b5715a46-2d59-41e9-be7a-ea06000f72a7" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4-b5715a46-2d59-41e9-be7a-ea06000f72a7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Creating volume b5715a46-2d59-41e9-be7a-ea06000f72a7 from snapshot 0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-b5715a46-2d59-41e9-be7a-ea06000f72a7" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-b5715a46-2d59-41e9-be7a-ea06000f72a7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] snapshot: 0bb105d4-0746-4d2f-8e1c-b1eab38e21e4, volume: b5715a46-2d59-41e9-be7a-ea06000f72a7, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896b34e-0590-4c31-89a8-d2259617cca6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:29 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 Jul 10 00:41:29 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:30 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" returned: 0 in 1.085s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f17104-82d1-4515-bbc3-020498bb8351(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:41:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:41:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:41:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[54366226-43f3-4317-bb43-5ae836506784]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:30 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 Jul 10 00:41:30 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:31 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351" returned: 0 in 1.008s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:31 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:41:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:31 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 Jul 10 00:41:31 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-00e6d954-082a-4e6a-ae1f-cf073a23cc3d tempest-GroupsV314Test-1084772971 None] Group tempest-GroupsV314Test-Group-1703556838: creating Jul 10 00:41:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-00e6d954-082a-4e6a-ae1f-cf073a23cc3d tempest-GroupsV314Test-1084772971 None] Group tempest-GroupsV314Test-Group-1703556838: created successfully Jul 10 00:41:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-00e6d954-082a-4e6a-ae1f-cf073a23cc3d tempest-GroupsV314Test-1084772971 None] Create group completed successfully. Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Flow 'volume_create_manager' (16aed033-e430-4a0b-86cb-f1021640bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd3d576-9bae-439f-b81e-14d1b86b55b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd3d576-9bae-439f-b81e-14d1b86b55b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-51861339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=645ddd28-4fc8-430f-bfb4-ef2cfe0892bb,host='devstack@QuobyteHD#QuobyteHD',id=acc38b8a-8390-4d46-88aa-af3132f4955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcefeb32fcae4e9595ff012751f6b3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:37Z,use_quota=True,user_id='34447a0277dc4688bc24c67dadbd8fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c705b25-62cb-4845-ae32-a87ba82caf70),volume_type_id=6c705b25-62cb-4845-ae32-a87ba82caf70)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2523998-adb3-44b3-92b0-77dc6334156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2523998-adb3-44b3-92b0-77dc6334156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b3e316-279f-45b6-a09a-c21c8148a6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b3e316-279f-45b6-a09a-c21c8148a6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc38b8a-8390-4d46-88aa-af3132f4955d', 'volume_name': 'volume-acc38b8a-8390-4d46-88aa-af3132f4955d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13bdcc2-3f5f-49bf-bc8a-a00e8a51a5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13bdcc2-3f5f-49bf-bc8a-a00e8a51a5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6e969e-1a7e-428c-aab4-4aeeee7d113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:37 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Volume acc38b8a-8390-4d46-88aa-af3132f4955d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc38b8a-8390-4d46-88aa-af3132f4955d', 'volume_size': 1} Jul 10 00:41:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:38 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7" returned: 0 in 6.591s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:38 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f5d661-96be-44c4-857b-29f1da1f3eb6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:38 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 Jul 10 00:41:38 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:39 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351" returned: 0 in 1.003s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:39 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:41:39 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Converted 1024.00 MB image at 155.35 MB/s Jul 10 00:41:39 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 is being set with open permissions: ugo+rw Jul 10 00:41:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:39 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 Jul 10 00:41:39 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:40 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7" returned: 0 in 0.747s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-b5715a46-2d59-41e9-be7a-ea06000f72a7" released by "_copy_volume_from_snapshot" :: held 10.550s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4-b5715a46-2d59-41e9-be7a-ea06000f72a7" released by "_create_volume_from_snapshot" :: held 10.586s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.605s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.469s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=645ddd28-4fc8-430f-bfb4-ef2cfe0892bb,created_at=2026-07-09T22:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-51861339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=645ddd28-4fc8-430f-bfb4-ef2cfe0892bb,host='devstack@QuobyteHD#QuobyteHD',id=acc38b8a-8390-4d46-88aa-af3132f4955d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcefeb32fcae4e9595ff012751f6b3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:37Z,use_quota=True,user_id='34447a0277dc4688bc24c67dadbd8fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c705b25-62cb-4845-ae32-a87ba82caf70),volume_type_id=6c705b25-62cb-4845-ae32-a87ba82caf70)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Creating volume acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:40 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:40 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d 1073741824 Jul 10 00:41:40 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d391e1-8b6c-496f-8ad9-aeb8e47d9192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5715a46-2d59-41e9-be7a-ea06000f72a7', 'volume_size': 1, 'snapshot_id': '0bb105d4-0746-4d2f-8e1c-b1eab38e21e4'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ec937a-8d2f-47a0-9c21-0225f85fe9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:40 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Volume volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 (b5715a46-2d59-41e9-be7a-ea06000f72a7): created successfully Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ec937a-8d2f-47a0-9c21-0225f85fe9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Flow 'volume_create_manager' (255e0295-4e48-4a87-958e-f225d6e7dd80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-126b3005-6374-4a99-aae4-108c890b40d7 tempest-VolumesSnapshotTestJSON-425856056 None] Created volume successfully. Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-b5715a46-2d59-41e9-be7a-ea06000f72a7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-b5715a46-2d59-41e9-be7a-ea06000f72a7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-b5715a46-2d59-41e9-be7a-ea06000f72a7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-b5715a46-2d59-41e9-be7a-ea06000f72a7" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae8c25-e260-44ef-99b7-bc73e2a4c6c2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:40 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 Jul 10 00:41:40 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:41 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d 1073741824" returned: 0 in 0.959s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:41 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d Jul 10 00:41:41 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:41 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7" returned: 0 in 0.834s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:41 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7 Jul 10 00:41:41 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:41 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6e969e-1a7e-428c-aab4-4aeeee7d113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc38b8a-8390-4d46-88aa-af3132f4955d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc261156-3e73-42a6-b11a-4b24dc96f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:41 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Volume volume-acc38b8a-8390-4d46-88aa-af3132f4955d (acc38b8a-8390-4d46-88aa-af3132f4955d): created successfully Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc261156-3e73-42a6-b11a-4b24dc96f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Flow 'volume_create_manager' (16aed033-e430-4a0b-86cb-f1021640bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:42 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-607b7d29-716a-4764-ae69-4a21e897c146 tempest-GroupsV314Test-1084772971 None] Created volume successfully. Jul 10 00:41:42 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5715a46-2d59-41e9-be7a-ea06000f72a7" returned: 0 in 0.853s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-b5715a46-2d59-41e9-be7a-ea06000f72a7" released by "delete_volume" :: held 1.731s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['1e2139db-f2b9-4a5d-8322-a2ee8df36adf', '5ad16279-ac88-45a1-9c5f-4bdd292d3df8', '5cf57baf-0564-40c6-9e3c-e9f2898ff8cd', 'f2009109-76c7-4eae-8c6b-1ba89380ee6a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:42 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:42 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-c9f17104-82d1-4515-bbc3-020498bb8351" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-c9f17104-82d1-4515-bbc3-020498bb8351" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Deleting offline snapshot 0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 of volume c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] snapshot_file for this snap is: volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a823d31f-36c7-42fc-be7a-d5f37697ac95]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:43 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 Jul 10 00:41:43 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:43 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.763s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:43 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:43 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Deleted volume successfully. Jul 10 00:41:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7837e119-0f0d-45f0-b2c2-6abd1d571f75 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-b5715a46-2d59-41e9-be7a-ea06000f72a7-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:43 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Cloning volume acc38b8a-8390-4d46-88aa-af3132f4955d to volume 93d6b57b-6cb5-4745-b789-07c630971287 Jul 10 00:41:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Creating offline snapshot 89a098a5-7501-4233-bc12-07d42447b1b7 of volume acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:41:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f4b159-d39e-4e2b-a587-845f996670e4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:44 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" returned: 0 in 1.102s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f17104-82d1-4515-bbc3-020498bb8351(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:41:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348b74c-3f93-48ac-9fdb-a8f8289c5e0d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:44 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d Jul 10 00:41:44 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:44 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 Jul 10 00:41:44 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:45 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d" returned: 0 in 1.035s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:45 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 1G Jul 10 00:41:45 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:45 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351" returned: 0 in 1.033s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:45 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 Jul 10 00:41:45 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:46 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" returned: 0 in 0.874s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:46 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4 Jul 10 00:41:46 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:46 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 1G" returned: 0 in 1.201s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acc38b8a-8390-4d46-88aa-af3132f4955d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:46 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acc38b8a-8390-4d46-88aa-af3132f4955d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 Jul 10 00:41:46 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:46 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351.0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" returned: 0 in 0.732s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4" released by "_delete_snapshot" :: held 3.934s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-c9f17104-82d1-4515-bbc3-020498bb8351" released by "delete_snapshot" :: held 3.967s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:46 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['1bc00da8-e803-4cea-a50b-29b3d28bd7b7', '328e1e84-75ee-401d-a7d6-229dfa255224', '23262b06-dedf-4341-aea3-5f99fa6d4776', '5c37d2af-8d0d-49ef-979a-a2a4bd22f508'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Delete snapshot completed successfully. Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-36b6e888-9ccd-4eee-9970-6f1afafb91ea tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-0bb105d4-0746-4d2f-8e1c-b1eab38e21e4-delete_snapshot" released by "delete_snapshot" :: held 4.141s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:47 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acc38b8a-8390-4d46-88aa-af3132f4955d -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7" returned: 0 in 0.932s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:47 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:47 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 Jul 10 00:41:47 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-c9f17104-82d1-4515-bbc3-020498bb8351-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-c9f17104-82d1-4515-bbc3-020498bb8351-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-c9f17104-82d1-4515-bbc3-020498bb8351" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-c9f17104-82d1-4515-bbc3-020498bb8351" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[90027d61-9d59-438f-8c30-46acf5be9236]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:47 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 Jul 10 00:41:47 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:48 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7" returned: 0 in 1.053s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:48 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.info Jul 10 00:41:48 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:48 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351" returned: 0 in 1.125s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:48 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351 Jul 10 00:41:48 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:49 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.info" returned: 0 in 1.071s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:49 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:41:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:49 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.info Jul 10 00:41:49 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:49 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9f17104-82d1-4515-bbc3-020498bb8351" returned: 0 in 0.873s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-c9f17104-82d1-4515-bbc3-020498bb8351" released by "delete_volume" :: held 2.088s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['16eecabb-beec-4b5b-a8e3-fbc801b5fa18', '76687411-eb96-4a88-8f18-03c43fcfa6d3', '302ce51f-8b04-498e-a022-ea1f05519a64', '1e4fc0f9-587b-4550-9a7e-4e60ed6d8232'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:50 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:50 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:50 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.info" returned: 0 in 0.972s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Acquiring lock "cinder-quobyte-93d6b57b-6cb5-4745-b789-07c630971287" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-93d6b57b-6cb5-4745-b789-07c630971287" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] snapshot: 89a098a5-7501-4233-bc12-07d42447b1b7, volume: 93d6b57b-6cb5-4745-b789-07c630971287, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c1a129-6951-4e89-9ace-81c6389ea22f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:50 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 Jul 10 00:41:50 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:51 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.796s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Deleted volume successfully. Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a17c0315-0e27-4d37-821f-409906a771e0 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-c9f17104-82d1-4515-bbc3-020498bb8351-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-bae0acc1-4ebb-45ee-baae-e21675706cc3-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-bae0acc1-4ebb-45ee-baae-e21675706cc3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "cinder-quobyte-bae0acc1-4ebb-45ee-baae-e21675706cc3" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-bae0acc1-4ebb-45ee-baae-e21675706cc3" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd42ca5-a2cf-42e4-ab58-8c305f0e2682]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:51 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7" returned: 0 in 1.081s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acc38b8a-8390-4d46-88aa-af3132f4955d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a762b0-8954-432b-b98a-cb799bc3d925]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:51 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 Jul 10 00:41:51 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:51 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d Jul 10 00:41:51 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:52 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d" returned: 0 in 0.926s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:52 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:52 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:41:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3" returned: 0 in 1.023s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:52 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 Jul 10 00:41:52 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:52 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3 Jul 10 00:41:52 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:53 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bae0acc1-4ebb-45ee-baae-e21675706cc3" returned: 0 in 0.901s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-quobyte-bae0acc1-4ebb-45ee-baae-e21675706cc3" released by "delete_volume" :: held 2.015s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Created reservations ['4168ef60-f284-4a3f-b850-c8850539a592', 'cc06f592-938f-4190-9af2-3be677b9a7b6', '7377672c-4888-4343-98a0-86d6e2b66532', 'e109fbfd-5f43-434b-89de-30faabfe0bd1'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:53 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:53 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:53 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-ab5078ea-97f3-43b9-88ea-50e3a655fbe0 req-52099095-c1d1-499b-a553-267023118f79 tempest-AttachVolumeNegativeTest-1182203413 None] Terminate volume connection completed successfully. Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ab5078ea-97f3-43b9-88ea-50e3a655fbe0 req-52099095-c1d1-499b-a553-267023118f79 tempest-AttachVolumeNegativeTest-1182203413 None] Deleting attachment 0a2b85f1-3f62-4395-8b83-6ea2e20a5d19. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:54 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:41:54 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:54 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.251s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:41:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:41:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Flow 'volume_create_manager' (3c481d6c-b5f3-4091-b216-30e4fdfab717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5cc80b-33e4-4f1b-bce1-5c2640ecb597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5cc80b-33e4-4f1b-bce1-5c2640ecb597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1221489669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3d10ef-ac26-44c7-a684-5649d0efb177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b536469e0d6b4762ba06e1860a2f2516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:56Z,use_quota=True,user_id='9e01c104929d460689f4c3a8a5be705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2383d306-a148-4a9e-88bc-0b76ec540bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2383d306-a148-4a9e-88bc-0b76ec540bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5475fb3a-4fb6-46b1-978d-d0581eb9f6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5475fb3a-4fb6-46b1-978d-d0581eb9f6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3d10ef-ac26-44c7-a684-5649d0efb177', 'volume_name': 'volume-0d3d10ef-ac26-44c7-a684-5649d0efb177', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688c8e14-4edf-4e99-87fd-608fc5a3dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688c8e14-4edf-4e99-87fd-608fc5a3dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37510fff-d3d8-491c-8195-88378aa06f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Volume 0d3d10ef-ac26-44c7-a684-5649d0efb177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3d10ef-ac26-44c7-a684-5649d0efb177', 'volume_size': 1} Jul 10 00:41:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:56 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 2.310s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:56 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Deleted volume successfully. Jul 10 00:41:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5b5eeac9-00b4-4def-87b2-f22325df11c9 tempest-VolumesSnapshotTestJSON-425856056 None] Lock "cinder-bae0acc1-4ebb-45ee-baae-e21675706cc3-delete_volume" released by "delete_volume" :: held 4.994s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:59 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287" returned: 0 in 7.007s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:59 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5379e07-7e6e-4320-8508-b617fd6d98a0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:59 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d Jul 10 00:41:59 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:00 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d" returned: 0 in 1.286s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:00 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:42:00 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Converted 1024.00 MB image at 146.10 MB/s Jul 10 00:42:00 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:42:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:00 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 Jul 10 00:42:00 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:01 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287" returned: 0 in 0.739s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-93d6b57b-6cb5-4745-b789-07c630971287" released by "_copy_volume_from_snapshot" :: held 11.160s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Acquiring lock "cinder-quobyte-89a098a5-7501-4233-bc12-07d42447b1b7" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-89a098a5-7501-4233-bc12-07d42447b1b7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Deleting offline snapshot 89a098a5-7501-4233-bc12-07d42447b1b7 of volume acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] snapshot_file for this snap is: volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[54197504-0825-4efe-b22f-6ba284358b75]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:01 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 Jul 10 00:42:01 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:02 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7" returned: 0 in 0.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acc38b8a-8390-4d46-88aa-af3132f4955d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:42:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a659e3e-bd68-4760-b530-727e69f1d8a4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:02 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d Jul 10 00:42:02 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:03 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d" returned: 0 in 0.857s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:03 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 Jul 10 00:42:03 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:04 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7" returned: 0 in 0.805s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:04 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7 Jul 10 00:42:04 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Flow 'volume_create_manager' (9912bbe6-9ec5-480e-ba19-f7f1a5c76f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0508f6b1-ff13-4342-a376-7bd22c6aaf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0508f6b1-ff13-4342-a376-7bd22c6aaf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1928293706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec29252-ed78-4a2c-947d-44487291b37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316e2abd52714fa5bd1b05c29a473d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:05Z,use_quota=True,user_id='c5d48ecf189d4bafb83f9ce251721033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ff504f-2219-4e3c-8906-865db8b3a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ff504f-2219-4e3c-8906-865db8b3a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b0484-ca2b-4de9-b54d-873786a50923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b0484-ca2b-4de9-b54d-873786a50923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec29252-ed78-4a2c-947d-44487291b37a', 'volume_name': 'volume-fec29252-ed78-4a2c-947d-44487291b37a', 'volume_size': 2}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf7025d-c2a3-4341-a329-5942e4084a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf7025d-c2a3-4341-a329-5942e4084a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e85a575-eac4-4849-a5c6-055d147f27b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:04 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Volume fec29252-ed78-4a2c-947d-44487291b37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec29252-ed78-4a2c-947d-44487291b37a', 'volume_size': 2} Jul 10 00:42:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:05 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d.89a098a5-7501-4233-bc12-07d42447b1b7" returned: 0 in 0.789s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-89a098a5-7501-4233-bc12-07d42447b1b7" released by "_delete_snapshot" :: held 3.482s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.191s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.098s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1221489669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3d10ef-ac26-44c7-a684-5649d0efb177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b536469e0d6b4762ba06e1860a2f2516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:56Z,use_quota=True,user_id='9e01c104929d460689f4c3a8a5be705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Creating volume 0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:42:05 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:05 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 1073741824 Jul 10 00:42:05 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b100809a-4361-44a3-aeeb-ba3388572ac9 tempest-GroupsV314Test-1084772971 None] Create group from source-group-645ddd28-4fc8-430f-bfb4-ef2cfe0892bb completed successfully. Jul 10 00:42:05 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 1073741824" returned: 0 in 0.896s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:06 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 Jul 10 00:42:06 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Acquiring lock "cinder-quobyte-93d6b57b-6cb5-4745-b789-07c630971287" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-93d6b57b-6cb5-4745-b789-07c630971287" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[74586bba-894a-4a86-a167-1655578272e9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:06 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.068s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1928293706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec29252-ed78-4a2c-947d-44487291b37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='316e2abd52714fa5bd1b05c29a473d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:05Z,use_quota=True,user_id='c5d48ecf189d4bafb83f9ce251721033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Creating volume fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:42:06 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a 2147483648 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37510fff-d3d8-491c-8195-88378aa06f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3d10ef-ac26-44c7-a684-5649d0efb177', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:06 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a 2147483648 Jul 10 00:42:06 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba286fa0-c1d6-4259-b815-0b0bcba92a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:06 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 Jul 10 00:42:06 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:06 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Volume volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 (0d3d10ef-ac26-44c7-a684-5649d0efb177): created successfully Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba286fa0-c1d6-4259-b815-0b0bcba92a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Flow 'volume_create_manager' (3c481d6c-b5f3-4091-b216-30e4fdfab717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c1f8d70c-6151-4c23-bbcf-bc5c16c0da25 tempest-SnapshotDependencyTests-1458896901 None] Created volume successfully. Jul 10 00:42:07 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287" returned: 0 in 0.885s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:07 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287 Jul 10 00:42:07 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:07 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a 2147483648" returned: 0 in 1.164s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:08 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a Jul 10 00:42:08 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:08 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-93d6b57b-6cb5-4745-b789-07c630971287" returned: 0 in 0.704s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-93d6b57b-6cb5-4745-b789-07c630971287" released by "delete_volume" :: held 1.644s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Created reservations ['f393c3dd-8c3d-4b86-a937-4b8b5816fc16'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:08 devstack cinder-volume[87452]: WARNING cinder.quota [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1804045668 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1804045668, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:42:08 devstack cinder-volume[87452]: WARNING cinder.quota [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1804045668 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1804045668, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Created reservations ['224a2021-13a8-422a-95bd-d9b530cc2e61', '21d80a5b-3400-4a46-b5a1-53d0f93e71a3', '84a7d659-9744-43a2-ab1f-c6cbf8705eae', '6ac7f029-0b15-4352-b665-0174ab361cb8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:08 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:42:08 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:08 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a" returned: 0 in 0.725s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.885s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Creating offline snapshot 6ce0c741-50f9-4a41-b88f-2ca32cb72f86 of volume 0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e85a575-eac4-4849-a5c6-055d147f27b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec29252-ed78-4a2c-947d-44487291b37a', 'volume_size': 2}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dbd07e-87c2-4b58-9d6f-6c49aba80493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6c09fa-e527-4a71-b1fc-c29753a61d0e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:08 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Volume volume-fec29252-ed78-4a2c-947d-44487291b37a (fec29252-ed78-4a2c-947d-44487291b37a): created successfully Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dbd07e-87c2-4b58-9d6f-6c49aba80493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Flow 'volume_create_manager' (9912bbe6-9ec5-480e-ba19-f7f1a5c76f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0e776b49-b778-4a6e-a8d8-91b0a0bb52eb tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Created volume successfully. Jul 10 00:42:08 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 Jul 10 00:42:08 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:09 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.750s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4703121c-b87f-41a8-aa01-7238967af84a tempest-GroupsV314Test-1084772971 None] Delete group completed successfully. Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Acquiring lock "cinder-quobyte-acc38b8a-8390-4d46-88aa-af3132f4955d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-acc38b8a-8390-4d46-88aa-af3132f4955d" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[308c4bf8-ed9d-41a4-8354-fe1f9c5c8e0f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:09 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d Jul 10 00:42:09 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:09 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177" returned: 0 in 0.865s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:09 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 1G Jul 10 00:42:09 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:10 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d" returned: 0 in 0.870s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:10 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d Jul 10 00:42:10 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:10 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 1G" returned: 0 in 1.123s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:10 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 Jul 10 00:42:10 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:10 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-acc38b8a-8390-4d46-88aa-af3132f4955d" returned: 0 in 0.678s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Lock "cinder-quobyte-acc38b8a-8390-4d46-88aa-af3132f4955d" released by "delete_volume" :: held 1.615s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Created reservations ['580a52f8-8d06-4fc8-9115-284d40a1250b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Created reservations ['e8f8f5a2-81a4-407e-97e2-61d7973702c7', '739e5923-1263-4459-999a-fe7c65be9d63', '63ea4d0d-65d4-4a6c-a360-6e17e2aaf0e8', 'e6e90aeb-6322-44e6-be8c-806b80b31346'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:11 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:42:11 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:11 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86" returned: 0 in 0.757s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:11 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 is being set with open permissions: ugo+rw Jul 10 00:42:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:11 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 Jul 10 00:42:11 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:12 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.790s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:12 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ece8bc59-5ae5-4629-969e-96902d25dd62 tempest-GroupsV314Test-1084772971 None] Delete group completed successfully. Jul 10 00:42:12 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86" returned: 0 in 0.714s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:12 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.info Jul 10 00:42:12 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:13 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.info" returned: 0 in 0.771s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:13 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.info is being set with open permissions: ugo+rw Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:13 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.info Jul 10 00:42:13 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:13 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.info" returned: 0 in 0.698s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.077s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.469s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Creating offline snapshot 132b417f-c44e-4f58-a011-5b9ae0175e0c of volume fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:42:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7e7ec27c-9e52-4be6-9582-6335ed2b7f8f tempest-SnapshotDependencyTests-1458896901 None] Create snapshot completed successfully Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[34525574-d1b9-429a-948d-77d04a9f27c7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:14 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a Jul 10 00:42:14 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:15 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a" returned: 0 in 1.272s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c 2G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:15 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c 2G Jul 10 00:42:15 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Flow 'volume_create_manager' (722cf3bf-50a4-4445-877b-bac2b83ca523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d239770c-f71e-4a9f-ad45-f0065c34be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d239770c-f71e-4a9f-ad45-f0065c34be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d553d343-d0b9-419a-b5b8-677920060811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b536469e0d6b4762ba06e1860a2f2516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ce0c741-50f9-4a41-b88f-2ca32cb72f86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:15Z,use_quota=True,user_id='9e01c104929d460689f4c3a8a5be705b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159da2ca-44c9-459e-a388-db776e3e89ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159da2ca-44c9-459e-a388-db776e3e89ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3e7a15-ac18-4fa1-82f5-b9a51a39a541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3e7a15-ac18-4fa1-82f5-b9a51a39a541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd553d343-d0b9-419a-b5b8-677920060811', 'volume_name': 'volume-d553d343-d0b9-419a-b5b8-677920060811', 'volume_size': 1, 'snapshot_id': '6ce0c741-50f9-4a41-b88f-2ca32cb72f86'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55deaf92-c166-499b-9923-34efd162674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55deaf92-c166-499b-9923-34efd162674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ed5f6d-3ccf-476d-8a2f-bb423dde0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:15 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Volume d553d343-d0b9-419a-b5b8-677920060811: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d553d343-d0b9-419a-b5b8-677920060811', 'volume_size': 1, 'snapshot_id': '6ce0c741-50f9-4a41-b88f-2ca32cb72f86'} Jul 10 00:42:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:16 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c 2G" returned: 0 in 1.104s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fec29252-ed78-4a2c-947d-44487291b37a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:16 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fec29252-ed78-4a2c-947d-44487291b37a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c Jul 10 00:42:16 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:17 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fec29252-ed78-4a2c-947d-44487291b37a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c" returned: 0 in 0.947s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:17 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c is being set with open permissions: ugo+rw Jul 10 00:42:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:17 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c Jul 10 00:42:17 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:17 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c" returned: 0 in 0.750s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:18 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.info Jul 10 00:42:18 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:18 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.info" returned: 0 in 0.736s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:18 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.info is being set with open permissions: ugo+rw Jul 10 00:42:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:18 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.info Jul 10 00:42:18 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:19 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.info" returned: 0 in 0.707s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.670s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.111s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-quobyte-6ce0c741-50f9-4a41-b88f-2ca32cb72f86-d553d343-d0b9-419a-b5b8-677920060811" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-6ce0c741-50f9-4a41-b88f-2ca32cb72f86-d553d343-d0b9-419a-b5b8-677920060811" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Creating volume d553d343-d0b9-419a-b5b8-677920060811 from snapshot 6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-quobyte-d553d343-d0b9-419a-b5b8-677920060811" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-d553d343-d0b9-419a-b5b8-677920060811" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] snapshot: 6ce0c741-50f9-4a41-b88f-2ca32cb72f86, volume: d553d343-d0b9-419a-b5b8-677920060811, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:42:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-639296ef-aa08-406d-ba06-971960bc4e12 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Create snapshot completed successfully Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7eba5c-36f5-4c0d-bcf0-844bf77364ee]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:19 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 Jul 10 00:42:19 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "cinder-132b417f-c44e-4f58-a011-5b9ae0175e0c-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-132b417f-c44e-4f58-a011-5b9ae0175e0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "cinder-quobyte-fec29252-ed78-4a2c-947d-44487291b37a" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-quobyte-fec29252-ed78-4a2c-947d-44487291b37a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "cinder-quobyte-132b417f-c44e-4f58-a011-5b9ae0175e0c" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-quobyte-132b417f-c44e-4f58-a011-5b9ae0175e0c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Deleting offline snapshot 132b417f-c44e-4f58-a011-5b9ae0175e0c of volume fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] snapshot_file for this snap is: volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea19953d-a308-44f5-a3ae-aaedbe84270c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:20 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c Jul 10 00:42:20 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:20 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86" returned: 0 in 1.274s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3d10ef-ac26-44c7-a684-5649d0efb177(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80e1381-5342-4b39-97d1-6aad7131eeb7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:21 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 Jul 10 00:42:21 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:21 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c" returned: 0 in 1.379s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fec29252-ed78-4a2c-947d-44487291b37a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:42:21 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72a390-04a2-40f2-ad19-db404885dbaf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:21 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a Jul 10 00:42:21 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:21 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177" returned: 0 in 1.048s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:21 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:42:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:22 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 Jul 10 00:42:22 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:22 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a" returned: 0 in 1.091s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:22 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c Jul 10 00:42:22 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:24 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c" returned: 0 in 1.834s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:24 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c Jul 10 00:42:24 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:26 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a.132b417f-c44e-4f58-a011-5b9ae0175e0c" returned: 0 in 2.028s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:26 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=86,cinder:SELECT=82,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:42:26 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=67,cinder:INSERT=21,cinder:UPDATE=77,cinder:DELETE=6 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:42:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-quobyte-132b417f-c44e-4f58-a011-5b9ae0175e0c" released by "_delete_snapshot" :: held 6.554s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-quobyte-fec29252-ed78-4a2c-947d-44487291b37a" released by "delete_snapshot" :: held 6.600s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:26 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Created reservations ['f048d67f-d556-4cc2-8f3a-68cef9323053', 'e3e30453-a32a-4ed1-ab62-31404dbf53c0', 'c7707932-8d8d-4d8d-8c3a-ea1b8ce11081', '4c8f2a2a-f6ff-4239-a5c9-1b3ebebc14ef'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Delete snapshot completed successfully. Jul 10 00:42:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d8c36e98-bd38-41be-889f-cab9118220f5 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-132b417f-c44e-4f58-a011-5b9ae0175e0c-delete_snapshot" released by "delete_snapshot" :: held 7.283s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "cinder-fec29252-ed78-4a2c-947d-44487291b37a-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-fec29252-ed78-4a2c-947d-44487291b37a-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "cinder-quobyte-fec29252-ed78-4a2c-947d-44487291b37a" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-quobyte-fec29252-ed78-4a2c-947d-44487291b37a" acquired by "delete_volume" :: waited 0.058s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:28 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db14311-5416-4753-9655-88363edc717a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:29 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a Jul 10 00:42:29 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:30 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811" returned: 0 in 8.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5236f53b-ebaa-4c54-950e-c5b69668a1e5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:31 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a" returned: 0 in 2.509s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:31 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a Jul 10 00:42:31 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:31 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 Jul 10 00:42:31 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:31 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fec29252-ed78-4a2c-947d-44487291b37a" returned: 0 in 0.933s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-quobyte-fec29252-ed78-4a2c-947d-44487291b37a" released by "delete_volume" :: held 3.627s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Created reservations ['2e38d825-53bf-4d92-b226-a081c05ebadd', 'd1489135-3094-4e57-bedb-6698775c9b82', '74909c7a-8acf-4351-a4c8-82539b3f5b5e', '61f98b93-acdd-49bc-86cb-00965f76a84e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:32 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:42:32 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:32 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177" returned: 0 in 1.343s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177, size 1024.00 MB, duration 8.92 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:42:32 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Converted 1024.00 MB image at 114.84 MB/s Jul 10 00:42:32 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 is being set with open permissions: ugo+rw Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:32 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 Jul 10 00:42:32 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:32 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.740s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Deleted volume successfully. Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e23b558-b7f4-4d87-9bff-dc76f8292334 tempest-VolumesSnapshotNegativeTestJSON-2056676487 None] Lock "cinder-fec29252-ed78-4a2c-947d-44487291b37a-delete_volume" released by "delete_volume" :: held 4.895s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:33 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811" returned: 0 in 0.877s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-d553d343-d0b9-419a-b5b8-677920060811" released by "_copy_volume_from_snapshot" :: held 13.613s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-6ce0c741-50f9-4a41-b88f-2ca32cb72f86-d553d343-d0b9-419a-b5b8-677920060811" released by "_create_volume_from_snapshot" :: held 13.651s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.678s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ed5f6d-3ccf-476d-8a2f-bb423dde0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d553d343-d0b9-419a-b5b8-677920060811', 'volume_size': 1, 'snapshot_id': '6ce0c741-50f9-4a41-b88f-2ca32cb72f86'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc5f89-9df0-42bc-9313-caf377266bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:33 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Volume volume-d553d343-d0b9-419a-b5b8-677920060811 (d553d343-d0b9-419a-b5b8-677920060811): created successfully Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc5f89-9df0-42bc-9313-caf377266bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Flow 'volume_create_manager' (722cf3bf-50a4-4445-877b-bac2b83ca523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cda0dd2c-b50d-4e51-87ca-e5eea753212e tempest-SnapshotDependencyTests-1458896901 None] Created volume successfully. Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-6ce0c741-50f9-4a41-b88f-2ca32cb72f86-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-6ce0c741-50f9-4a41-b88f-2ca32cb72f86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-quobyte-0d3d10ef-ac26-44c7-a684-5649d0efb177" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-0d3d10ef-ac26-44c7-a684-5649d0efb177" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-quobyte-6ce0c741-50f9-4a41-b88f-2ca32cb72f86" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-6ce0c741-50f9-4a41-b88f-2ca32cb72f86" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Deleting offline snapshot 6ce0c741-50f9-4a41-b88f-2ca32cb72f86 of volume 0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] snapshot_file for this snap is: volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bfef10-a5ee-4a0d-9937-4eef2d251055]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:34 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 Jul 10 00:42:34 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:35 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86" returned: 0 in 1.116s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3d10ef-ac26-44c7-a684-5649d0efb177(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:42:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c32b8-b2b5-4a93-bcdc-35fa17c1d302]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:35 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 Jul 10 00:42:35 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:36 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177" returned: 0 in 1.122s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:36 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 Jul 10 00:42:36 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:37 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86" returned: 0 in 1.033s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:37 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86 Jul 10 00:42:37 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:37 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177.6ce0c741-50f9-4a41-b88f-2ca32cb72f86" returned: 0 in 0.712s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-6ce0c741-50f9-4a41-b88f-2ca32cb72f86" released by "_delete_snapshot" :: held 4.127s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-0d3d10ef-ac26-44c7-a684-5649d0efb177" released by "delete_snapshot" :: held 4.167s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:38 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Created reservations ['2e789b13-34d3-4561-9b45-7b3d2c8a7cd0', 'a4cfdca2-a740-45dc-8ab5-6d231fec14d1', '9b946a05-2b90-42cb-a1d4-2c0295b5c749', '49039633-b775-4fcc-800a-26d4a331ff9c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:38 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Delete snapshot completed successfully. Jul 10 00:42:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-345e3257-359d-4d99-9f17-354050c47dc8 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-6ce0c741-50f9-4a41-b88f-2ca32cb72f86-delete_snapshot" released by "delete_snapshot" :: held 4.496s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-0d3d10ef-ac26-44c7-a684-5649d0efb177-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-0d3d10ef-ac26-44c7-a684-5649d0efb177-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-quobyte-0d3d10ef-ac26-44c7-a684-5649d0efb177" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-0d3d10ef-ac26-44c7-a684-5649d0efb177" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d9c46-365c-496e-9f3e-3e51ce4bf113]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:39 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 Jul 10 00:42:39 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Flow 'volume_create_manager' (f83a8e79-c6e6-49b5-bf5d-7511bd633407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44700674-0925-44b3-b3bb-563f77f9b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44700674-0925-44b3-b3bb-563f77f9b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1972896693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245d36c1-6477-4526-8a68-539337b944f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cafdfeec794cf9bff1f7dc95292f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:40Z,use_quota=True,user_id='35319a4285cf48ffb3d854f4b2295840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3063261c-9f97-49f6-91ed-a41f65f4337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3063261c-9f97-49f6-91ed-a41f65f4337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd0fd50-9704-4a23-9b8c-3b63f3cd9b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd0fd50-9704-4a23-9b8c-3b63f3cd9b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245d36c1-6477-4526-8a68-539337b944f9', 'volume_name': 'volume-245d36c1-6477-4526-8a68-539337b944f9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68110e60-e6b7-4920-8631-6858c14c74b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68110e60-e6b7-4920-8631-6858c14c74b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44419881-b2d8-4e42-8921-4ff23b5ceaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:39 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Volume 245d36c1-6477-4526-8a68-539337b944f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245d36c1-6477-4526-8a68-539337b944f9', 'volume_size': 1} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1972896693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245d36c1-6477-4526-8a68-539337b944f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cafdfeec794cf9bff1f7dc95292f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:40Z,use_quota=True,user_id='35319a4285cf48ffb3d854f4b2295840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Creating volume 245d36c1-6477-4526-8a68-539337b944f9 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:42:39 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:42:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:39 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 1073741824 Jul 10 00:42:39 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:40 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177" returned: 0 in 0.842s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:40 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177 Jul 10 00:42:40 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:40 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 1073741824" returned: 0 in 0.905s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:40 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 Jul 10 00:42:40 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:40 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d3d10ef-ac26-44c7-a684-5649d0efb177" returned: 0 in 0.746s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-0d3d10ef-ac26-44c7-a684-5649d0efb177" released by "delete_volume" :: held 1.687s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Created reservations ['07d86763-e110-45f6-b887-8515a44b40e0', '013837ff-bfda-4c02-8b45-ab17d0000bfa', '9671f37d-05e7-42f9-8871-5e2100219845', '1182c5a7-3ff4-4dbc-9be0-6e361de5adfa'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:41 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:42:41 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-d553d343-d0b9-419a-b5b8-677920060811-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-d553d343-d0b9-419a-b5b8-677920060811-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "cinder-quobyte-d553d343-d0b9-419a-b5b8-677920060811" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:41 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-d553d343-d0b9-419a-b5b8-677920060811" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44419881-b2d8-4e42-8921-4ff23b5ceaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245d36c1-6477-4526-8a68-539337b944f9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05affaa4-9588-419d-bfba-3ce69d4d2b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afd263f-8e36-48a6-82f1-1142d543f998]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:41 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Volume volume-245d36c1-6477-4526-8a68-539337b944f9 (245d36c1-6477-4526-8a68-539337b944f9): created successfully Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05affaa4-9588-419d-bfba-3ce69d4d2b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Flow 'volume_create_manager' (f83a8e79-c6e6-49b5-bf5d-7511bd633407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-370271f2-fca7-4d8d-8a22-6e6776f46c56 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Created volume successfully. Jul 10 00:42:41 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 Jul 10 00:42:41 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:41 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.872s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:41 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Deleted volume successfully. Jul 10 00:42:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b73c7c60-9588-42ea-9aa4-4ab6f6f1f1b3 tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-0d3d10ef-ac26-44c7-a684-5649d0efb177-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:42 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811" returned: 0 in 0.944s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:42 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811 Jul 10 00:42:42 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Acquiring lock "cinder-245d36c1-6477-4526-8a68-539337b944f9-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "cinder-245d36c1-6477-4526-8a68-539337b944f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Acquiring lock "cinder-quobyte-245d36c1-6477-4526-8a68-539337b944f9" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "cinder-quobyte-245d36c1-6477-4526-8a68-539337b944f9" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eed5144-65aa-463c-a4f1-4eaafe6b9a8e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:43 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 Jul 10 00:42:43 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:43 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d553d343-d0b9-419a-b5b8-677920060811" returned: 0 in 0.749s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-quobyte-d553d343-d0b9-419a-b5b8-677920060811" released by "delete_volume" :: held 1.755s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Created reservations ['35fed2b6-6450-4510-a6e6-5f8c79c85239', '6af0a110-df67-46e4-ba58-6c10d90067f5', '70836983-6cbf-459c-8c1d-b2295bc7c16d', '36219071-8a43-4d62-82b6-68dedbbfe085'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:43 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:42:43 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:44 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9" returned: 0 in 1.178s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:44 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9 Jul 10 00:42:44 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:44 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.955s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:44 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Deleted volume successfully. Jul 10 00:42:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06d57d48-49f2-4f66-b1b2-d9ede99f5aab tempest-SnapshotDependencyTests-1458896901 None] Lock "cinder-d553d343-d0b9-419a-b5b8-677920060811-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:45 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-245d36c1-6477-4526-8a68-539337b944f9" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "cinder-quobyte-245d36c1-6477-4526-8a68-539337b944f9" released by "delete_volume" :: held 2.047s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Created reservations ['dba52948-c9ae-4d7d-8589-0b6c3b074126', 'c54e7dac-435d-4767-b602-bc5e3c34ef34', 'e995b142-a0d1-4723-ba0e-376f0e40e77b', 'c7e9779a-9ba4-4f75-854f-39a0e6d26644'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:45 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:42:45 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:46 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.887s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:46 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:46 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Deleted volume successfully. Jul 10 00:42:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7d384b22-d048-482b-9899-04a33f4bac23 tempest-VolumeQuotasNegativeTestJSON-1678236247 None] Lock "cinder-245d36c1-6477-4526-8a68-539337b944f9-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Flow 'volume_create_manager' (0ee55530-a783-4ca8-bc99-2e871f2790da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aca9225-2c6c-4774-ac10-d809ece3c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aca9225-2c6c-4774-ac10-d809ece3c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1975592895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce373ad-c155-446e-a329-c1b43a8eec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed41c1d37374beea4b1a1adcb6441a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:52Z,use_quota=True,user_id='6147ad8eb41b4016b17a7810d2bb22c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff87abd-7ea8-4c6a-9c33-370fbcfcb2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff87abd-7ea8-4c6a-9c33-370fbcfcb2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c046dc-921d-4eec-8ebf-0bbcc4466bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c046dc-921d-4eec-8ebf-0bbcc4466bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce373ad-c155-446e-a329-c1b43a8eec26', 'volume_name': 'volume-dce373ad-c155-446e-a329-c1b43a8eec26', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790bf3b6-ff5f-42a7-ace7-10bda732b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790bf3b6-ff5f-42a7-ace7-10bda732b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f38b861-72ff-4791-afd9-74d8631d2310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:51 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Volume dce373ad-c155-446e-a329-c1b43a8eec26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce373ad-c155-446e-a329-c1b43a8eec26', 'volume_size': 1} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1975592895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce373ad-c155-446e-a329-c1b43a8eec26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed41c1d37374beea4b1a1adcb6441a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:52Z,use_quota=True,user_id='6147ad8eb41b4016b17a7810d2bb22c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Creating volume dce373ad-c155-446e-a329-c1b43a8eec26 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:42:51 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:42:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:51 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 1073741824 Jul 10 00:42:51 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:53 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 1073741824" returned: 0 in 1.172s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:53 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 Jul 10 00:42:53 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:53 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:42:53 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:54 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26" returned: 0 in 1.048s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f38b861-72ff-4791-afd9-74d8631d2310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce373ad-c155-446e-a329-c1b43a8eec26', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1172a947-4cca-45cd-8d5e-de9f957c0288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Volume volume-dce373ad-c155-446e-a329-c1b43a8eec26 (dce373ad-c155-446e-a329-c1b43a8eec26): created successfully Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1172a947-4cca-45cd-8d5e-de9f957c0288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Flow 'volume_create_manager' (0ee55530-a783-4ca8-bc99-2e871f2790da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:54 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-27ead1d3-528b-4ac3-92f9-d9fe3cdb6c80 tempest-AttachVolumeNegativeTest-1182203413 None] Created volume successfully. Jul 10 00:42:54 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.984s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:42:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:42:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ec82209f-544e-4e82-b318-38853f0053d4 req-057a3290-335e-44ee-b5ff-4e364ef0574a tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ec82209f-544e-4e82-b318-38853f0053d4 req-057a3290-335e-44ee-b5ff-4e364ef0574a tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bb9aa8-6270-439e-82b8-6899bad58b2b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ec82209f-544e-4e82-b318-38853f0053d4 req-057a3290-335e-44ee-b5ff-4e364ef0574a tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:58 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 Jul 10 00:42:58 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:59 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ec82209f-544e-4e82-b318-38853f0053d4 req-057a3290-335e-44ee-b5ff-4e364ef0574a tempest-AttachVolumeNegativeTest-1182203413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26" returned: 0 in 0.938s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ec82209f-544e-4e82-b318-38853f0053d4 req-057a3290-335e-44ee-b5ff-4e364ef0574a tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.964s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ec82209f-544e-4e82-b318-38853f0053d4 req-057a3290-335e-44ee-b5ff-4e364ef0574a tempest-AttachVolumeNegativeTest-1182203413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-dce373ad-c155-446e-a329-c1b43a8eec26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48fa509c-9ae1-4dda-822b-54763e4e7b1c', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:42:59 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-ec82209f-544e-4e82-b318-38853f0053d4 req-057a3290-335e-44ee-b5ff-4e364ef0574a tempest-AttachVolumeNegativeTest-1182203413 None] attachment_update completed successfully. Jul 10 00:43:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-df9dbca9-46fe-4376-b0f9-54129ee5a192 req-b7b28522-9663-4adb-9b06-36c8af4f0628 tempest-AttachVolumeNegativeTest-1182203413 None] Terminate volume connection completed successfully. Jul 10 00:43:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-df9dbca9-46fe-4376-b0f9-54129ee5a192 req-b7b28522-9663-4adb-9b06-36c8af4f0628 tempest-AttachVolumeNegativeTest-1182203413 None] Deleting attachment 48fa509c-9ae1-4dda-822b-54763e4e7b1c. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:43:18 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=37,cinder:INSERT=11,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:43:18 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=46,cinder:INSERT=15,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (219abc56-87ca-4eec-9611-c6078046a7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b10ba5-1ca9-47fa-9d8c-40e601ac698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b10ba5-1ca9-47fa-9d8c-40e601ac698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1218947146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d382eac8-a2a8-40a3-86f0-37924da747ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:43:43Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9968b3bb-4b71-4019-a577-55e2ff9b84e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9968b3bb-4b71-4019-a577-55e2ff9b84e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacde037-dba9-46ca-af7c-e3ab70f914f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacde037-dba9-46ca-af7c-e3ab70f914f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd382eac8-a2a8-40a3-86f0-37924da747ba', 'volume_name': 'volume-d382eac8-a2a8-40a3-86f0-37924da747ba', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7e418b-870a-4f5e-a33e-84468be8966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7e418b-870a-4f5e-a33e-84468be8966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3c1e17-9f8d-44f8-9fec-efe22f6b995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:43 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Volume d382eac8-a2a8-40a3-86f0-37924da747ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d382eac8-a2a8-40a3-86f0-37924da747ba', 'volume_size': 1} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1218947146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d382eac8-a2a8-40a3-86f0-37924da747ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:43:43Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Creating volume d382eac8-a2a8-40a3-86f0-37924da747ba {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:43:43 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:43:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:43 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba 1073741824 Jul 10 00:43:43 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:44 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba 1073741824" returned: 0 in 0.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:44 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba Jul 10 00:43:44 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:44 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba" returned: 0 in 0.639s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3c1e17-9f8d-44f8-9fec-efe22f6b995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d382eac8-a2a8-40a3-86f0-37924da747ba', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b6ef7c-db58-4c32-a249-2e8203660059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:44 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Volume volume-d382eac8-a2a8-40a3-86f0-37924da747ba (d382eac8-a2a8-40a3-86f0-37924da747ba): created successfully Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b6ef7c-db58-4c32-a249-2e8203660059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (219abc56-87ca-4eec-9611-c6078046a7af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:43:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-330b902c-3ac5-44be-a75b-38caafc1d5c0 tempest-VolumesActionsTest-1389161356 None] Created volume successfully. Jul 10 00:43:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b3513a2-89fa-42d4-a40e-827ec68b92d2 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba" by "attach_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b3513a2-89fa-42d4-a40e-827ec68b92d2 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba" acquired by "attach_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0b3513a2-89fa-42d4-a40e-827ec68b92d2 tempest-VolumesActionsTest-1389161356 None] Attaching volume d382eac8-a2a8-40a3-86f0-37924da747ba to instance 6f51fca3-0dd1-4101-8a75-adacba5378a2 at mountpoint /dev/vdb on host None. Jul 10 00:43:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0b3513a2-89fa-42d4-a40e-827ec68b92d2 tempest-VolumesActionsTest-1389161356 None] Attach volume completed successfully. Jul 10 00:43:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0b3513a2-89fa-42d4-a40e-827ec68b92d2 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba" released by "attach_volume" :: held 0.105s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:46 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e40ad8c1-4700-4939-a274-20acf8afddb5 tempest-VolumesActionsTest-2073869779 None] Terminate volume connection completed successfully. Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Flow 'volume_create_manager' (39767718-c5e8-40da-aa4b-9806f466d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84558bf6-e3a3-46cf-8812-c9f8a38f60b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e40ad8c1-4700-4939-a274-20acf8afddb5 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-detach_volume" by "detach_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84558bf6-e3a3-46cf-8812-c9f8a38f60b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-425100613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aca0b9695a4e30b654609604adf137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:43:47Z,use_quota=True,user_id='20b9d19329f247e0ae12a700667a2d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd6190-4a60-4746-b267-847fed5c39e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd6190-4a60-4746-b267-847fed5c39e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc3642d-cc01-4a9b-8b35-0be3241e924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc3642d-cc01-4a9b-8b35-0be3241e924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30', 'volume_name': 'volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f560f35-73d0-487c-91c6-a05f95c9cb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f560f35-73d0-487c-91c6-a05f95c9cb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a155de1-e311-4c07-8ef7-99c8f9e4a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Volume a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30', 'volume_size': 1} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-425100613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61aca0b9695a4e30b654609604adf137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:43:47Z,use_quota=True,user_id='20b9d19329f247e0ae12a700667a2d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Creating volume a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:43:46 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:43:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e40ad8c1-4700-4939-a274-20acf8afddb5 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-detach_volume" acquired by "detach_volume" :: waited 0.086s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:47 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 1073741824 Jul 10 00:43:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e40ad8c1-4700-4939-a274-20acf8afddb5 tempest-VolumesActionsTest-2073869779 None] Detaching volume d382eac8-a2a8-40a3-86f0-37924da747ba from instance 6f51fca3-0dd1-4101-8a75-adacba5378a2. Jul 10 00:43:47 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e40ad8c1-4700-4939-a274-20acf8afddb5 tempest-VolumesActionsTest-2073869779 None] Detach volume completed successfully. Jul 10 00:43:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e40ad8c1-4700-4939-a274-20acf8afddb5 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-52c0748e-d279-4d03-bc5c-84e5e8f77c62 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-detach_volume" by "detach_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-52c0748e-d279-4d03-bc5c-84e5e8f77c62 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-52c0748e-d279-4d03-bc5c-84e5e8f77c62 tempest-VolumesActionsTest-1389161356 None] Volume detach called, but volume not attached. Jul 10 00:43:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-52c0748e-d279-4d03-bc5c-84e5e8f77c62 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:47 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 1073741824" returned: 0 in 0.934s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:48 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 Jul 10 00:43:48 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Acquiring lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Acquiring lock "cinder-quobyte-d382eac8-a2a8-40a3-86f0-37924da747ba" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Lock "cinder-quobyte-d382eac8-a2a8-40a3-86f0-37924da747ba" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300487c-4a9b-4314-8b7d-1a349953245a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:48 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30" returned: 0 in 0.740s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a155de1-e311-4c07-8ef7-99c8f9e4a35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ab10ea-3235-46ec-bda2-44b1dcf3515e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Volume volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 (a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30): created successfully Jul 10 00:43:48 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba Jul 10 00:43:48 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ab10ea-3235-46ec-bda2-44b1dcf3515e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Flow 'volume_create_manager' (39767718-c5e8-40da-aa4b-9806f466d32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:43:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-caf21b77-902f-46d1-905f-5a7d9c7a55f9 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Created volume successfully. Jul 10 00:43:49 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba" returned: 0 in 0.862s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:49 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba Jul 10 00:43:49 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:50 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d382eac8-a2a8-40a3-86f0-37924da747ba" returned: 0 in 0.686s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Lock "cinder-quobyte-d382eac8-a2a8-40a3-86f0-37924da747ba" released by "delete_volume" :: held 1.599s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Created reservations ['6c333428-0a36-4ce3-8055-682c5f289490', '26818d81-448d-4c2d-b69d-e6d0d9d23d23', '6ee56c19-d293-439a-bd29-640222b9d820', 'a63e6466-86d8-4e50-b4b7-dfb7dc1dd3c4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:50 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:43:50 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:51 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.816s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:51 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:43:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Deleted volume successfully. Jul 10 00:43:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3c68573f-0fd9-424f-a49f-6e80ea5325ea tempest-VolumesActionsTest-1389161356 None] Lock "cinder-d382eac8-a2a8-40a3-86f0-37924da747ba-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-dfbc0e50-e9fe-4328-a326-fb510ad2d4d3 req-b8d28a2f-b8fd-4de4-9dfb-0f8c6a149456 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-dfbc0e50-e9fe-4328-a326-fb510ad2d4d3 req-b8d28a2f-b8fd-4de4-9dfb-0f8c6a149456 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0189eca-98e3-4a05-867b-06b2d0378377]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:43:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-dfbc0e50-e9fe-4328-a326-fb510ad2d4d3 req-b8d28a2f-b8fd-4de4-9dfb-0f8c6a149456 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:52 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 Jul 10 00:43:52 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:53 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-dfbc0e50-e9fe-4328-a326-fb510ad2d4d3 req-b8d28a2f-b8fd-4de4-9dfb-0f8c6a149456 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30" returned: 0 in 0.848s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-dfbc0e50-e9fe-4328-a326-fb510ad2d4d3 req-b8d28a2f-b8fd-4de4-9dfb-0f8c6a149456 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-dfbc0e50-e9fe-4328-a326-fb510ad2d4d3 req-b8d28a2f-b8fd-4de4-9dfb-0f8c6a149456 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1d73eaa-ab4f-4ebd-b852-f6187abf80d6', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:43:53 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-dfbc0e50-e9fe-4328-a326-fb510ad2d4d3 req-b8d28a2f-b8fd-4de4-9dfb-0f8c6a149456 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] attachment_update completed successfully. Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:53 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:43:53 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:54 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:43:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:43:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:43:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (a4f93fa6-e1de-466b-8cfe-2ba4a737dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d4bf59-3e64-4502-9f6e-7abec1b9f892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d4bf59-3e64-4502-9f6e-7abec1b9f892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053026739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f5b990-087d-4a19-89ce-693c43e0acc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:43:59Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea154d5-8c0e-47fe-854d-5680ba6b2e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea154d5-8c0e-47fe-854d-5680ba6b2e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaae472-a6bd-4476-be36-0d1bd439ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaae472-a6bd-4476-be36-0d1bd439ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f5b990-087d-4a19-89ce-693c43e0acc4', 'volume_name': 'volume-b5f5b990-087d-4a19-89ce-693c43e0acc4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52750220-b22c-4d09-86bf-e7501fa21a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52750220-b22c-4d09-86bf-e7501fa21a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdc1e74-1d54-4024-9fcf-981906ebbf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:43:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Volume b5f5b990-087d-4a19-89ce-693c43e0acc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f5b990-087d-4a19-89ce-693c43e0acc4', 'volume_size': 1} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2053026739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f5b990-087d-4a19-89ce-693c43e0acc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:43:59Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Creating volume b5f5b990-087d-4a19-89ce-693c43e0acc4 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:43:58 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:43:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:58 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 1073741824 Jul 10 00:43:58 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:59 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 1073741824" returned: 0 in 0.960s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:59 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 Jul 10 00:43:59 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:00 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4" returned: 0 in 0.725s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdc1e74-1d54-4024-9fcf-981906ebbf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f5b990-087d-4a19-89ce-693c43e0acc4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9325cbf1-f798-4969-b0de-30541066f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Volume volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 (b5f5b990-087d-4a19-89ce-693c43e0acc4): created successfully Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9325cbf1-f798-4969-b0de-30541066f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (a4f93fa6-e1de-466b-8cfe-2ba4a737dfec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-055dc344-615c-4f36-9e5e-0c4495fc4696 tempest-VolumesActionsTest-1389161356 None] Created volume successfully. Jul 10 00:44:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-385c5dd2-6fbd-43ea-9df0-3e596a7054f0 req-45678a6c-d85c-4108-ba67-be81b1e39cc1 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Terminate volume connection completed successfully. Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-385c5dd2-6fbd-43ea-9df0-3e596a7054f0 req-45678a6c-d85c-4108-ba67-be81b1e39cc1 tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Deleting attachment a1d73eaa-ab4f-4ebd-b852-f6187abf80d6. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-b5f5b990-087d-4a19-89ce-693c43e0acc4-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-b5f5b990-087d-4a19-89ce-693c43e0acc4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-quobyte-b5f5b990-087d-4a19-89ce-693c43e0acc4" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-b5f5b990-087d-4a19-89ce-693c43e0acc4" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bbb308-8ecc-40b2-9aae-5f5576ae61d4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:01 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 Jul 10 00:44:01 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:01 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4" returned: 0 in 0.746s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:01 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4 Jul 10 00:44:01 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:02 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b5f5b990-087d-4a19-89ce-693c43e0acc4" returned: 0 in 0.637s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-b5f5b990-087d-4a19-89ce-693c43e0acc4" released by "delete_volume" :: held 1.428s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Created reservations ['472309e7-3058-46e0-bebb-314421092d52', '31f7a162-c3cf-4a95-8973-50ed364c6723', '397b7627-df32-4722-995c-0f566d71d495', 'f0541036-3921-4d8e-ab14-905f22324355'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:02 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:02 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Flow 'volume_create_manager' (618b139d-2c7b-48bc-bf13-5b8569747db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dc4b5a-b3a2-4f30-be03-cfc3d7934a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dc4b5a-b3a2-4f30-be03-cfc3d7934a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1298460582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbd9efc-db6a-4c5f-8547-af367eb53b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed41c1d37374beea4b1a1adcb6441a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:03Z,use_quota=True,user_id='6147ad8eb41b4016b17a7810d2bb22c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebab0883-bf05-40ca-a790-37467a0c8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebab0883-bf05-40ca-a790-37467a0c8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d781b680-a565-4a6e-9637-def8c3b6eb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d781b680-a565-4a6e-9637-def8c3b6eb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbd9efc-db6a-4c5f-8547-af367eb53b20', 'volume_name': 'volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f1a572-83b8-4636-a4ed-8c4dc4321b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f1a572-83b8-4636-a4ed-8c4dc4321b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee982cf-a03d-421e-94e4-b4e37cf89221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:02 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Volume 0bbd9efc-db6a-4c5f-8547-af367eb53b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20', 'volume_size': 1} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1298460582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbd9efc-db6a-4c5f-8547-af367eb53b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed41c1d37374beea4b1a1adcb6441a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:03Z,use_quota=True,user_id='6147ad8eb41b4016b17a7810d2bb22c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Creating volume 0bbd9efc-db6a-4c5f-8547-af367eb53b20 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:02 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:02 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 1073741824 Jul 10 00:44:02 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Acquiring lock "cinder-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "cinder-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Acquiring lock "cinder-quobyte-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "cinder-quobyte-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30" acquired by "delete_volume" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf59af04-c6b8-4d84-9e8e-b3f838e2bea7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:03 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 Jul 10 00:44:03 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:03 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.803s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Deleted volume successfully. Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cfe4674c-6b5e-4f1c-b6a5-4826b185c282 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-b5f5b990-087d-4a19-89ce-693c43e0acc4-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:03 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 1073741824" returned: 0 in 0.987s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (6c189891-cec7-4f82-9843-5c6a7026900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea6f682-6746-4439-a10e-e05e6a43a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:03 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 Jul 10 00:44:03 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea6f682-6746-4439-a10e-e05e6a43a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17174488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c324fa-6257-4112-8a8d-54492ba1bab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:04Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d0df6-0d57-4853-92f5-a63ed932f149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6d0df6-0d57-4853-92f5-a63ed932f149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39b0b37-3d80-43f9-999c-095720fc7f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39b0b37-3d80-43f9-999c-095720fc7f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c324fa-6257-4112-8a8d-54492ba1bab4', 'volume_name': 'volume-b2c324fa-6257-4112-8a8d-54492ba1bab4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcbafed-16b7-444e-a849-3158642201c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcbafed-16b7-444e-a849-3158642201c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7598e308-a83a-4d1f-ba43-7ca4baadf1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Volume b2c324fa-6257-4112-8a8d-54492ba1bab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c324fa-6257-4112-8a8d-54492ba1bab4', 'volume_size': 1} Jul 10 00:44:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:04 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30" returned: 0 in 0.985s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:04 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30 Jul 10 00:44:04 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:04 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20" returned: 0 in 0.704s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17174488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c324fa-6257-4112-8a8d-54492ba1bab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:04Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Creating volume b2c324fa-6257-4112-8a8d-54492ba1bab4 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:04 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee982cf-a03d-421e-94e4-b4e37cf89221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:04 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 1073741824 Jul 10 00:44:04 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7147f1-1185-4304-b9e6-9b2420f1dee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:04 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Volume volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 (0bbd9efc-db6a-4c5f-8547-af367eb53b20): created successfully Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7147f1-1185-4304-b9e6-9b2420f1dee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Flow 'volume_create_manager' (618b139d-2c7b-48bc-bf13-5b8569747db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-51493ee3-48e3-46d9-a08e-26149e5d0444 tempest-AttachVolumeNegativeTest-1182203413 None] Created volume successfully. Jul 10 00:44:04 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30" returned: 0 in 0.660s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "cinder-quobyte-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30" released by "delete_volume" :: held 1.703s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Created reservations ['8a93eb3f-bfb4-49b7-8e6c-4ec962365822', '77ce9c4a-e437-4e16-bad8-15f57453607b', '64edb926-fcdf-4a0b-b6a8-0d522448cc5f', 'f30747f4-4c79-47a9-ade7-aed8a0080dfa'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:04 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:04 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:05 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.727s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:05 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Deleted volume successfully. Jul 10 00:44:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dbb98748-5cce-422a-b173-65bba90aeb6d tempest-TestServerVolumeAttachScenarioOldVersion-1713100099 None] Lock "cinder-a92f7b9f-5cc2-4ca9-9e40-357f96cb1d30-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:05 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 1073741824" returned: 0 in 1.026s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:05 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 Jul 10 00:44:05 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:06 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4" returned: 0 in 0.708s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7598e308-a83a-4d1f-ba43-7ca4baadf1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c324fa-6257-4112-8a8d-54492ba1bab4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b227d935-f9f1-43af-a2ba-33296bbbcc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:06 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Volume volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 (b2c324fa-6257-4112-8a8d-54492ba1bab4): created successfully Jul 10 00:44:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b227d935-f9f1-43af-a2ba-33296bbbcc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (6c189891-cec7-4f82-9843-5c6a7026900c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c3c64b35-4819-4fe7-9464-af26aaddf1bf tempest-VolumesActionsTest-1389161356 None] Created volume successfully. Jul 10 00:44:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-b2c324fa-6257-4112-8a8d-54492ba1bab4-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-b2c324fa-6257-4112-8a8d-54492ba1bab4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-quobyte-b2c324fa-6257-4112-8a8d-54492ba1bab4" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-b2c324fa-6257-4112-8a8d-54492ba1bab4" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff0c6d6-83d2-41b5-9364-1d17fac61897]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:07 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 Jul 10 00:44:07 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-d7f8fdc8-6453-45a8-8700-68cbd1135277 req-37b171c8-070d-4fcc-b25c-9008ef9e5845 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-d7f8fdc8-6453-45a8-8700-68cbd1135277 req-37b171c8-070d-4fcc-b25c-9008ef9e5845 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5391c515-d88c-4bf4-879b-e68ada9b1a19]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d7f8fdc8-6453-45a8-8700-68cbd1135277 req-37b171c8-070d-4fcc-b25c-9008ef9e5845 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:08 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 Jul 10 00:44:08 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:08 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4" returned: 0 in 1.010s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:08 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4 Jul 10 00:44:08 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:09 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d7f8fdc8-6453-45a8-8700-68cbd1135277 req-37b171c8-070d-4fcc-b25c-9008ef9e5845 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20" returned: 0 in 0.880s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-d7f8fdc8-6453-45a8-8700-68cbd1135277 req-37b171c8-070d-4fcc-b25c-9008ef9e5845 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.900s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-d7f8fdc8-6453-45a8-8700-68cbd1135277 req-37b171c8-070d-4fcc-b25c-9008ef9e5845 tempest-AttachVolumeNegativeTest-1182203413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc410015-5905-4547-8b4c-ee26a077a0d5', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:44:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-d7f8fdc8-6453-45a8-8700-68cbd1135277 req-37b171c8-070d-4fcc-b25c-9008ef9e5845 tempest-AttachVolumeNegativeTest-1182203413 None] attachment_update completed successfully. Jul 10 00:44:09 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2c324fa-6257-4112-8a8d-54492ba1bab4" returned: 0 in 0.817s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-b2c324fa-6257-4112-8a8d-54492ba1bab4" released by "delete_volume" :: held 1.884s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Created reservations ['1fde89e2-601d-446b-845b-9324b5b34d07', '25fc3b1a-73d6-4c02-884b-c0a1738ca49b', 'ec193e7f-9ff8-4a81-9f73-b93b84a4de74', '38876d19-7c25-4cb8-8d4a-d482f8c0cd68'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:09 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:09 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (c77d3807-03c4-4639-bc99-74aef9cdb10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14ee683-eaf9-4472-9f90-36a7d072423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:10 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.814s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14ee683-eaf9-4472-9f90-36a7d072423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1864568468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7e0e78-092c-4239-ac42-3400e6381102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:10Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5022f96-31f2-4abd-baa7-7626d4c8b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5022f96-31f2-4abd-baa7-7626d4c8b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aebb696-7c84-4975-92df-f462d60e7b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aebb696-7c84-4975-92df-f462d60e7b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe7e0e78-092c-4239-ac42-3400e6381102', 'volume_name': 'volume-fe7e0e78-092c-4239-ac42-3400e6381102', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6920a208-e5a3-43ad-af68-7de4cb41b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6920a208-e5a3-43ad-af68-7de4cb41b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98033aef-963c-48ec-a4c1-d4aafe796453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:10 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Volume fe7e0e78-092c-4239-ac42-3400e6381102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe7e0e78-092c-4239-ac42-3400e6381102', 'volume_size': 1} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1864568468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7e0e78-092c-4239-ac42-3400e6381102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:10Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Creating volume fe7e0e78-092c-4239-ac42-3400e6381102 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:10 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Deleted volume successfully. Jul 10 00:44:10 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 1073741824 Jul 10 00:44:10 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab627b2b-a6fd-4a11-81fa-905f06895c87 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-b2c324fa-6257-4112-8a8d-54492ba1bab4-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:11 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 1073741824" returned: 0 in 0.895s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:11 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 Jul 10 00:44:11 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:11 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102" returned: 0 in 0.677s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98033aef-963c-48ec-a4c1-d4aafe796453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe7e0e78-092c-4239-ac42-3400e6381102', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ca1d4b-80fa-4088-ab6e-54b857103123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:11 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Volume volume-fe7e0e78-092c-4239-ac42-3400e6381102 (fe7e0e78-092c-4239-ac42-3400e6381102): created successfully Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ca1d4b-80fa-4088-ab6e-54b857103123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (c77d3807-03c4-4639-bc99-74aef9cdb10c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b6f3ea58-5506-44c6-a103-94b75d2d55d7 tempest-VolumesActionsTest-1389161356 None] Created volume successfully. Jul 10 00:44:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-fe7e0e78-092c-4239-ac42-3400e6381102-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Lock "cinder-fe7e0e78-092c-4239-ac42-3400e6381102-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-quobyte-fe7e0e78-092c-4239-ac42-3400e6381102" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-fe7e0e78-092c-4239-ac42-3400e6381102" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca6858e-b6aa-405c-b4ac-60c5aa894f2c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:12 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 Jul 10 00:44:12 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:13 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102" returned: 0 in 0.785s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:13 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102 Jul 10 00:44:13 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:13 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fe7e0e78-092c-4239-ac42-3400e6381102" returned: 0 in 0.669s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-fe7e0e78-092c-4239-ac42-3400e6381102" released by "delete_volume" :: held 1.500s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Created reservations ['d39995b0-fe1c-45da-96ce-b038958e4099', 'e59f3630-a269-4ea5-ad67-b823a17ee6e7', '4a58afd3-345f-4395-a9db-3c60f8106048', '73715d88-6b3b-4967-8b49-06531af0079a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:14 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:14 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:14 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.798s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Deleted volume successfully. Jul 10 00:44:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8974b0d4-677d-4d9c-89ed-29186e5bd47f tempest-VolumesActionsTest-2073869779 None] Lock "cinder-fe7e0e78-092c-4239-ac42-3400e6381102-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (c43d4d7e-5035-42ea-b16b-7eabb16b90fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b26267-8f88-4e77-b174-274b9b6b9040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b26267-8f88-4e77-b174-274b9b6b9040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1348452519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cceb2f-4946-4bc1-8c9f-ee86c527ee70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:15Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df29ccbf-aa64-4533-9705-2a6ef81e5bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df29ccbf-aa64-4533-9705-2a6ef81e5bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed32d6ed-98ae-45b4-9b6a-da11e657007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed32d6ed-98ae-45b4-9b6a-da11e657007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cceb2f-4946-4bc1-8c9f-ee86c527ee70', 'volume_name': 'volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484eaf6e-9c58-4be8-b00d-0e9910045836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484eaf6e-9c58-4be8-b00d-0e9910045836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b74bbe-156d-4f3a-ab20-743a55b950b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:15 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Volume 97cceb2f-4946-4bc1-8c9f-ee86c527ee70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70', 'volume_size': 1} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1348452519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cceb2f-4946-4bc1-8c9f-ee86c527ee70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:15Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Creating volume 97cceb2f-4946-4bc1-8c9f-ee86c527ee70 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:15 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:15 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 1073741824 Jul 10 00:44:15 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:15 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-207da609-4056-4030-ba0e-2bcc47f2a49b req-bed22d15-a790-4c04-8501-c2a2eebc0ad3 tempest-AttachVolumeNegativeTest-1182203413 None] Terminate volume connection completed successfully. Jul 10 00:44:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-207da609-4056-4030-ba0e-2bcc47f2a49b req-bed22d15-a790-4c04-8501-c2a2eebc0ad3 tempest-AttachVolumeNegativeTest-1182203413 None] Deleting attachment cc410015-5905-4547-8b4c-ee26a077a0d5. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:44:16 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 1073741824" returned: 0 in 1.015s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:16 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 Jul 10 00:44:16 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:17 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70" returned: 0 in 0.779s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b74bbe-156d-4f3a-ab20-743a55b950b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05ba43b-ce5f-4228-ba50-b125d828289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:17 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Volume volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 (97cceb2f-4946-4bc1-8c9f-ee86c527ee70): created successfully Jul 10 00:44:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05ba43b-ce5f-4228-ba50-b125d828289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (c43d4d7e-5035-42ea-b16b-7eabb16b90fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1a2121fb-f12c-4cc6-a926-472a98892a53 tempest-VolumesActionsTest-1389161356 None] Created volume successfully. Jul 10 00:44:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-97cceb2f-4946-4bc1-8c9f-ee86c527ee70-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-97cceb2f-4946-4bc1-8c9f-ee86c527ee70-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "cinder-quobyte-97cceb2f-4946-4bc1-8c9f-ee86c527ee70" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-97cceb2f-4946-4bc1-8c9f-ee86c527ee70" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0bc70-923f-4ddf-9c32-2ae16570529a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:18 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 Jul 10 00:44:18 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:19 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70" returned: 0 in 0.851s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:19 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70 Jul 10 00:44:19 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:20 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-97cceb2f-4946-4bc1-8c9f-ee86c527ee70" returned: 0 in 0.873s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-quobyte-97cceb2f-4946-4bc1-8c9f-ee86c527ee70" released by "delete_volume" :: held 1.775s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Created reservations ['dc7427aa-e239-4e32-9ed9-5128331b6642', '19bec641-a632-445e-8fed-35891b6cf23b', '40d17e97-54c3-406c-9644-eb969f2745eb', '64b1dad4-71c3-484e-be6e-8e67e0cd777c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:20 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:20 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:21 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.087s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Deleted volume successfully. Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (b59d5420-a608-4003-8625-7f7864ab31c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976b436c-6de3-4bf0-a8c2-9c644ad500c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8799338-7da3-449b-9838-f76b193a9d61 tempest-VolumesActionsTest-2073869779 None] Lock "cinder-97cceb2f-4946-4bc1-8c9f-ee86c527ee70-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976b436c-6de3-4bf0-a8c2-9c644ad500c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-103672110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35707dfe-a74c-41f5-ae84-95986b3faa76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:22Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82012f0-b944-42c5-a047-8e4c1531603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82012f0-b944-42c5-a047-8e4c1531603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7909f7-f9f2-46c5-9dea-aec9f9a08b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7909f7-f9f2-46c5-9dea-aec9f9a08b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35707dfe-a74c-41f5-ae84-95986b3faa76', 'volume_name': 'volume-35707dfe-a74c-41f5-ae84-95986b3faa76', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840e5674-e508-4543-8e7c-4c9acca46f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840e5674-e508-4543-8e7c-4c9acca46f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66b8b2c-4c70-406f-bd7b-755b2f523560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:21 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Volume 35707dfe-a74c-41f5-ae84-95986b3faa76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35707dfe-a74c-41f5-ae84-95986b3faa76', 'volume_size': 1} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-103672110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35707dfe-a74c-41f5-ae84-95986b3faa76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf0a95bdf0406b9094272929c31c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:22Z,use_quota=True,user_id='26687d702ec8490582e3d67844f44820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Creating volume 35707dfe-a74c-41f5-ae84-95986b3faa76 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:21 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:21 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 1073741824 Jul 10 00:44:21 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:22 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 1073741824" returned: 0 in 1.045s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:22 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 Jul 10 00:44:22 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:23 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66b8b2c-4c70-406f-bd7b-755b2f523560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35707dfe-a74c-41f5-ae84-95986b3faa76', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a71915b-00cf-406e-aa81-11d5a8308127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:23 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Volume volume-35707dfe-a74c-41f5-ae84-95986b3faa76 (35707dfe-a74c-41f5-ae84-95986b3faa76): created successfully Jul 10 00:44:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a71915b-00cf-406e-aa81-11d5a8308127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Flow 'volume_create_manager' (b59d5420-a608-4003-8625-7f7864ab31c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-45e1a39b-d7f4-4600-b510-a57b47b0da24 tempest-VolumesActionsTest-1389161356 None] Created volume successfully. Jul 10 00:44:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "cinder-35707dfe-a74c-41f5-ae84-95986b3faa76-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-35707dfe-a74c-41f5-ae84-95986b3faa76-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "cinder-quobyte-35707dfe-a74c-41f5-ae84-95986b3faa76" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-quobyte-35707dfe-a74c-41f5-ae84-95986b3faa76" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:25 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[95583278-dff4-48c5-99e6-946a7291de61]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:25 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 Jul 10 00:44:25 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:26 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76" returned: 0 in 0.839s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:26 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76 Jul 10 00:44:26 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:27 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-35707dfe-a74c-41f5-ae84-95986b3faa76" returned: 0 in 0.770s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-quobyte-35707dfe-a74c-41f5-ae84-95986b3faa76" released by "delete_volume" :: held 1.653s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Created reservations ['ac6476ff-6dd0-4cf6-9837-06070f2320d2', '6df2f1f4-975c-4e80-8d4e-510f1e9eb18a', '2d6fbdc5-bb96-424d-90b8-4b51e9ab9b54', 'c79ae419-9228-4bef-b523-e78835286686'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "cinder-0bbd9efc-db6a-4c5f-8547-af367eb53b20-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-0bbd9efc-db6a-4c5f-8547-af367eb53b20-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:27 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:27 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "cinder-quobyte-0bbd9efc-db6a-4c5f-8547-af367eb53b20" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-quobyte-0bbd9efc-db6a-4c5f-8547-af367eb53b20" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb713933-6835-419f-b5f9-df1993b9e1c3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:27 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 Jul 10 00:44:27 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:28 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.837s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:28 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:28 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Deleted volume successfully. Jul 10 00:44:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-93f4cff0-b8b6-434f-8434-ab76841d2c79 tempest-VolumesActionsTest-1389161356 None] Lock "cinder-35707dfe-a74c-41f5-ae84-95986b3faa76-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:28 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20" returned: 0 in 0.982s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:28 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20 Jul 10 00:44:28 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:29 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0bbd9efc-db6a-4c5f-8547-af367eb53b20" returned: 0 in 0.775s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-quobyte-0bbd9efc-db6a-4c5f-8547-af367eb53b20" released by "delete_volume" :: held 1.803s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Created reservations ['f41d759c-274f-4805-8533-b565e17aa6b1', '0782705b-fd18-4d74-8bd7-2e561daed7af', '54a85cf8-1d87-43d3-b835-823b8ca056af', '9c9f992b-6068-4a8c-b8ff-a66e76e30c02'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:29 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:29 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "cinder-dce373ad-c155-446e-a329-c1b43a8eec26-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-dce373ad-c155-446e-a329-c1b43a8eec26-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "cinder-quobyte-dce373ad-c155-446e-a329-c1b43a8eec26" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-quobyte-dce373ad-c155-446e-a329-c1b43a8eec26" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[278ab672-e825-4647-9d70-818ce2625ffb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:30 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 Jul 10 00:44:30 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:30 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.822s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:30 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Deleted volume successfully. Jul 10 00:44:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-001cb6bd-e9ef-4eda-8c2c-43b0a07caa5f tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-0bbd9efc-db6a-4c5f-8547-af367eb53b20-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:30 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26" returned: 0 in 0.939s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:30 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26 Jul 10 00:44:30 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:31 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-dce373ad-c155-446e-a329-c1b43a8eec26" returned: 0 in 0.673s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-quobyte-dce373ad-c155-446e-a329-c1b43a8eec26" released by "delete_volume" :: held 1.664s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Created reservations ['2cc198a2-4344-40dc-a5bf-1032db6efc7a', 'e0642c51-40b9-4891-9d8e-977baca279f7', '679eb92b-3137-409d-843b-3ae32ea3606d', '7ad36301-470f-4127-a17e-ed8b0869b739'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:31 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:31 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "cinder-184f9d9d-138d-4aa4-bb50-499f0a44f850-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-184f9d9d-138d-4aa4-bb50-499f0a44f850-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "cinder-quobyte-184f9d9d-138d-4aa4-bb50-499f0a44f850" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-quobyte-184f9d9d-138d-4aa4-bb50-499f0a44f850" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e3271e-dd40-4347-a437-b18c0fac94f8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:32 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 Jul 10 00:44:32 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:32 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.980s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Deleted volume successfully. Jul 10 00:44:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0427ba52-e426-4856-8e8d-f43dd7908199 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-dce373ad-c155-446e-a329-c1b43a8eec26-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:33 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850" returned: 0 in 0.875s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:33 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850 Jul 10 00:44:33 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:34 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-184f9d9d-138d-4aa4-bb50-499f0a44f850" returned: 0 in 0.852s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-quobyte-184f9d9d-138d-4aa4-bb50-499f0a44f850" released by "delete_volume" :: held 1.805s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Created reservations ['0ff1ffc5-75fc-4284-ad13-3efb5b865be1', 'bf69bcbd-b70c-40e1-80fd-ff76beecc5da', '035bcd57-76e2-48bd-accc-701a096485ad', '5c2b32fd-34bb-403f-b19c-49b998cef907'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:34 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:34 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:35 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.020s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:35 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Deleted volume successfully. Jul 10 00:44:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5e55fe7d-b338-4f3e-aedd-7710995a81c0 tempest-AttachVolumeNegativeTest-1182203413 None] Lock "cinder-184f9d9d-138d-4aa4-bb50-499f0a44f850-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:44 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=91,cinder:UPDATE=102,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:44:45 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=119,cinder:SELECT=82,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Flow 'volume_create_manager' (3f53cf2d-25a4-4667-8844-e62a72e2d160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b86afc7-c1bf-45cd-831e-dc782e5eb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b86afc7-c1bf-45cd-831e-dc782e5eb40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1017451075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fc8913-7c56-46e7-9d1b-3deccfd302a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d089b34ea490b801e9a3fab3d1a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:46Z,use_quota=True,user_id='b514623b248f4402bb2d1a40e2263f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d65153-5d22-480c-9cca-6ef394c38516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d65153-5d22-480c-9cca-6ef394c38516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6202c1-bb81-47cb-9878-12c4c30246ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6202c1-bb81-47cb-9878-12c4c30246ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fc8913-7c56-46e7-9d1b-3deccfd302a8', 'volume_name': 'volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c8bcaf-45e4-4c0f-bd09-2205234f5010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c8bcaf-45e4-4c0f-bd09-2205234f5010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68705fb-da52-4df7-8add-1d78b28daeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Volume c2fc8913-7c56-46e7-9d1b-3deccfd302a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8', 'volume_size': 1} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1017451075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fc8913-7c56-46e7-9d1b-3deccfd302a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d089b34ea490b801e9a3fab3d1a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:46Z,use_quota=True,user_id='b514623b248f4402bb2d1a40e2263f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Creating volume c2fc8913-7c56-46e7-9d1b-3deccfd302a8 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:46 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:46 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 1073741824 Jul 10 00:44:46 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:47 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 1073741824" returned: 0 in 1.079s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:47 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 Jul 10 00:44:47 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:48 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8" returned: 0 in 0.756s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68705fb-da52-4df7-8add-1d78b28daeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6a6083-0304-4cdc-be7e-a35c446c8cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Volume volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 (c2fc8913-7c56-46e7-9d1b-3deccfd302a8): created successfully Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6a6083-0304-4cdc-be7e-a35c446c8cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Flow 'volume_create_manager' (3f53cf2d-25a4-4667-8844-e62a72e2d160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-ed17ada8-aa89-4ab3-b9e9-09a2be1f9a6d req-ea8e5e8d-4d5b-4aa1-909d-bbded16b2920 tempest-VolumesGetTestJSON-1212937281 None] Created volume successfully. Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Acquiring lock "cinder-c2fc8913-7c56-46e7-9d1b-3deccfd302a8-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Lock "cinder-c2fc8913-7c56-46e7-9d1b-3deccfd302a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Acquiring lock "cinder-quobyte-c2fc8913-7c56-46e7-9d1b-3deccfd302a8" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Lock "cinder-quobyte-c2fc8913-7c56-46e7-9d1b-3deccfd302a8" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:49 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b3a617-b724-4f1e-9044-95470e304cc7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:49 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 Jul 10 00:44:49 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:50 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8" returned: 0 in 1.021s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:50 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8 Jul 10 00:44:50 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:50 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c2fc8913-7c56-46e7-9d1b-3deccfd302a8" returned: 0 in 0.833s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Lock "cinder-quobyte-c2fc8913-7c56-46e7-9d1b-3deccfd302a8" released by "delete_volume" :: held 1.909s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:50 devstack cinder-volume[87452]: DEBUG cinder.quota [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Created reservations ['9a636f35-e4b8-49a4-a0ea-ca130b13f2ac', '98da6412-ca76-47e4-8ec1-faf2eaab5398', '6bfa0c23-9f8a-492e-a801-0f62296d7d8f', '0d14d7c1-e593-430c-9754-648a0136181a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Flow 'volume_create_manager' (056d94c7-ccab-4c00-ba83-57606985f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4750ab20-5cb3-4b05-b004-17ebf8abf6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4750ab20-5cb3-4b05-b004-17ebf8abf6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1797783198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0409cb42-32b4-48fe-9fa1-3b8c457cf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4936e90cb24de6a067fd31e69bb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:51Z,use_quota=True,user_id='f8e3500157cd4dcfacbc4a28f43f52a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7b5720-59c9-4a9e-9ed3-5a37dfea3eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7b5720-59c9-4a9e-9ed3-5a37dfea3eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de29fc-8dcb-4efe-ac0a-43ce22a6538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de29fc-8dcb-4efe-ac0a-43ce22a6538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0409cb42-32b4-48fe-9fa1-3b8c457cf4c9', 'volume_name': 'volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f77b6e-8ade-43d6-9586-67cfbf762abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f77b6e-8ade-43d6-9586-67cfbf762abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bf19a9-0c7d-4a53-ae85-5e0ed876c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Volume 0409cb42-32b4-48fe-9fa1-3b8c457cf4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9', 'volume_size': 1} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1797783198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0409cb42-32b4-48fe-9fa1-3b8c457cf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4936e90cb24de6a067fd31e69bb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:51Z,use_quota=True,user_id='f8e3500157cd4dcfacbc4a28f43f52a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Creating volume 0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:51 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:51 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 1073741824 Jul 10 00:44:51 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:51 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:51 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Flow 'volume_create_manager' (70c67911-31e7-4fd5-b1bd-cb9d5e5ebdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1fefb2-3a14-4261-961c-4944a5d07bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1fefb2-3a14-4261-961c-4944a5d07bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1529146051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f531d7897474e758fa843d1fbb54926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:51Z,use_quota=True,user_id='891cfcb01cda4b0885ec4ee8983890e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706862ba-b0ab-44ff-bb90-94f5c0a3bf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706862ba-b0ab-44ff-bb90-94f5c0a3bf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4de7316-b490-4df8-9910-20ec1db07900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4de7316-b490-4df8-9910-20ec1db07900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7', 'volume_name': 'volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24335cb3-f986-4fe5-85f3-781b8bd79811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24335cb3-f986-4fe5-85f3-781b8bd79811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1f344e-d7c7-43a8-bcf1-b5683eac09f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Volume 5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7', 'volume_size': 1} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Flow 'volume_create_manager' (b0eb170b-b3db-4440-a5d8-6f1e4c174d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bf60ee-0a4b-4adf-8640-0075506534b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bf60ee-0a4b-4adf-8640-0075506534b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-667227875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20360ab0-984f-4462-808e-3e019259da3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4936e90cb24de6a067fd31e69bb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:51Z,use_quota=True,user_id='f8e3500157cd4dcfacbc4a28f43f52a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c58281-809f-4bcc-bf5b-6101410ba431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c58281-809f-4bcc-bf5b-6101410ba431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4961052f-c54a-4c5a-b2ef-dc297d220af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4961052f-c54a-4c5a-b2ef-dc297d220af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20360ab0-984f-4462-808e-3e019259da3e', 'volume_name': 'volume-20360ab0-984f-4462-808e-3e019259da3e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d09ea2-57c5-453a-8b40-7641f9505b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d09ea2-57c5-453a-8b40-7641f9505b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e51319-9624-49e4-9a9f-c82592866991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:51 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Volume 20360ab0-984f-4462-808e-3e019259da3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20360ab0-984f-4462-808e-3e019259da3e', 'volume_size': 1} Jul 10 00:44:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:52 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.910s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:52 devstack cinder-volume[87452]: DEBUG cinder.manager [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:52 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Deleted volume successfully. Jul 10 00:44:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-e1f21394-911c-432f-ba3c-32edd0a8aa7b req-0eaff9e2-1bf9-4122-be72-28f6069655d6 tempest-VolumesGetTestJSON-1212937281 None] Lock "cinder-c2fc8913-7c56-46e7-9d1b-3deccfd302a8-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:52 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 1073741824" returned: 0 in 1.132s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:52 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 Jul 10 00:44:52 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:53 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9" returned: 0 in 0.768s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.715s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1529146051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f531d7897474e758fa843d1fbb54926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:51Z,use_quota=True,user_id='891cfcb01cda4b0885ec4ee8983890e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Creating volume 5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:53 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:53 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 1073741824 Jul 10 00:44:53 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bf19a9-0c7d-4a53-ae85-5e0ed876c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20330c27-5ea2-4845-81b5-750f14d89777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Volume volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 (0409cb42-32b4-48fe-9fa1-3b8c457cf4c9): created successfully Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20330c27-5ea2-4845-81b5-750f14d89777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Flow 'volume_create_manager' (056d94c7-ccab-4c00-ba83-57606985f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:53 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-12551106-fe4d-42b5-a409-5399ba2e0862 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Created volume successfully. Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:53 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:53 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:54 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 1073741824" returned: 0 in 1.077s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:54 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 Jul 10 00:44:54 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:54 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.876s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:44:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:44:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:44:55 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7" returned: 0 in 0.739s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.480s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-667227875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20360ab0-984f-4462-808e-3e019259da3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4936e90cb24de6a067fd31e69bb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:51Z,use_quota=True,user_id='f8e3500157cd4dcfacbc4a28f43f52a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Creating volume 20360ab0-984f-4462-808e-3e019259da3e {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:55 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1f344e-d7c7-43a8-bcf1-b5683eac09f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:55 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e 1073741824 Jul 10 00:44:55 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834fbda-5031-48ce-bc04-2d68bcc07476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Volume volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 (5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7): created successfully Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834fbda-5031-48ce-bc04-2d68bcc07476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Flow 'volume_create_manager' (70c67911-31e7-4fd5-b1bd-cb9d5e5ebdfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-683803de-1763-4164-8020-e686d4476f9c tempest-AbsoluteLimitsTests-404894418 None] Created volume successfully. Jul 10 00:44:56 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e 1073741824" returned: 0 in 1.055s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:56 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e Jul 10 00:44:56 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Acquiring lock "cinder-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Lock "cinder-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Acquiring lock "cinder-quobyte-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Lock "cinder-quobyte-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c28d77-5197-4514-bcdc-f41b7892983b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Flow 'volume_create_manager' (66977016-77bb-418d-a065-d3730f3e7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2a7d51-24f4-41ba-ae58-de530d915d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2a7d51-24f4-41ba-ae58-de530d915d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1647343953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75e4f7f-c761-4429-bcef-9a64bdbab3a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec32d2688e7a4d78af5ddd0122bd2ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:56Z,use_quota=True,user_id='d591fba950ef403793e9073ac811ced7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5152ea7d-b703-41f9-9393-7d5cde9fdc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5152ea7d-b703-41f9-9393-7d5cde9fdc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10baf78c-73ba-46af-8530-413d40e812fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10baf78c-73ba-46af-8530-413d40e812fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75e4f7f-c761-4429-bcef-9a64bdbab3a4', 'volume_name': 'volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5775d340-b643-44f4-b3d7-d5b99efe4031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5775d340-b643-44f4-b3d7-d5b99efe4031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:56 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 Jul 10 00:44:56 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be19cc7-79f9-4415-85e7-9957770e82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Volume c75e4f7f-c761-4429-bcef-9a64bdbab3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4', 'volume_size': 1} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:56 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e" returned: 0 in 0.783s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1647343953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75e4f7f-c761-4429-bcef-9a64bdbab3a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec32d2688e7a4d78af5ddd0122bd2ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:56Z,use_quota=True,user_id='d591fba950ef403793e9073ac811ced7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Creating volume c75e4f7f-c761-4429-bcef-9a64bdbab3a4 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:57 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e51319-9624-49e4-9a9f-c82592866991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20360ab0-984f-4462-808e-3e019259da3e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:57 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 1073741824 Jul 10 00:44:57 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8b50f9-39dc-4013-b8cd-3196f628125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:57 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Volume volume-20360ab0-984f-4462-808e-3e019259da3e (20360ab0-984f-4462-808e-3e019259da3e): created successfully Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8b50f9-39dc-4013-b8cd-3196f628125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Flow 'volume_create_manager' (b0eb170b-b3db-4440-a5d8-6f1e4c174d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-94067c87-9dd5-4dd4-ad45-f247a46e6301 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Created volume successfully. Jul 10 00:44:57 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7" returned: 0 in 0.879s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:57 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7 Jul 10 00:44:57 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:57 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 1073741824" returned: 0 in 0.905s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:57 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7" returned: 0 in 0.745s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:57 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 Jul 10 00:44:57 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Lock "cinder-quobyte-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7" released by "delete_volume" :: held 1.684s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Created reservations ['c4eba3c2-0cf8-41b7-b2b0-5d9ab87915c6', 'bcca30cd-511d-4b54-bcd5-56b88db59769', 'a0ab751a-d97d-4ffa-8e21-17fabe8c3df7', 'a30fea5d-539d-4c50-94ed-3f6ea85cbd13'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:58 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:44:58 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:58 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4" returned: 0 in 0.776s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be19cc7-79f9-4415-85e7-9957770e82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a847d03-ad5b-4a3c-ba9e-8a55b6119498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Volume volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 (c75e4f7f-c761-4429-bcef-9a64bdbab3a4): created successfully Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a847d03-ad5b-4a3c-ba9e-8a55b6119498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Flow 'volume_create_manager' (66977016-77bb-418d-a065-d3730f3e7e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7bdc606e-5c1a-4d11-9fe9-21c29b36a176 tempest-VolumesTestJSON-669999223 None] Created volume successfully. Jul 10 00:44:58 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Deleted volume successfully. Jul 10 00:44:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e71195c8-a02f-420d-b26c-5843986c9ea4 tempest-AbsoluteLimitsTests-404894418 None] Lock "cinder-5e0b7de0-c5b4-4580-9f46-7e8f03d45fa7-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Flow 'volume_create_manager' (a2e204c9-1983-4605-adda-e9c055cb1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a568af9b-45dd-434b-a08b-e4383f4b83a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a568af9b-45dd-434b-a08b-e4383f4b83a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1606074736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6610a224-64eb-44e2-9f9c-70f33fb95cc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec32d2688e7a4d78af5ddd0122bd2ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:00Z,use_quota=True,user_id='d591fba950ef403793e9073ac811ced7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62f33cf-fbf4-4647-a44a-7540861714ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62f33cf-fbf4-4647-a44a-7540861714ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa58b055-9ecb-49e3-a618-8f2cdd796722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa58b055-9ecb-49e3-a618-8f2cdd796722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6610a224-64eb-44e2-9f9c-70f33fb95cc1', 'volume_name': 'volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f80c0bf-8053-416f-b1c4-02fd7b8a0e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f80c0bf-8053-416f-b1c4-02fd7b8a0e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c63e594-6b74-4bf1-a784-839248694090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Volume 6610a224-64eb-44e2-9f9c-70f33fb95cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1', 'volume_size': 1} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1606074736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6610a224-64eb-44e2-9f9c-70f33fb95cc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec32d2688e7a4d78af5ddd0122bd2ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:00Z,use_quota=True,user_id='d591fba950ef403793e9073ac811ced7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Creating volume 6610a224-64eb-44e2-9f9c-70f33fb95cc1 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:00 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:45:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:00 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 1073741824 Jul 10 00:45:00 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:01 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 1073741824" returned: 0 in 1.126s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:01 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 Jul 10 00:45:01 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:02 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1" returned: 0 in 0.871s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c63e594-6b74-4bf1-a784-839248694090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd74d1-53fb-424d-8964-778d5956ccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:02 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Volume volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 (6610a224-64eb-44e2-9f9c-70f33fb95cc1): created successfully Jul 10 00:45:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfd74d1-53fb-424d-8964-778d5956ccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Flow 'volume_create_manager' (a2e204c9-1983-4605-adda-e9c055cb1e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1f4e98e0-6c72-4d20-9c10-0b4f809bc27a tempest-VolumesTestJSON-669999223 None] Created volume successfully. Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Flow 'volume_create_manager' (531338eb-9d2d-445e-887f-94999753f16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea49287-ff68-4d38-bb52-cb948cf1e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea49287-ff68-4d38-bb52-cb948cf1e28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-479760660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7630e6c1-17d2-4ed8-a735-2e86103e4087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc0894d64024d8a9e0293a72fe1d487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:03Z,use_quota=True,user_id='c65ee1adc64a4415b467da6edf4a8507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5cc7b7-33b6-4882-bb88-194c3ee38280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5cc7b7-33b6-4882-bb88-194c3ee38280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26750cf9-1ca3-4631-82ae-b1393cc5c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26750cf9-1ca3-4631-82ae-b1393cc5c951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7630e6c1-17d2-4ed8-a735-2e86103e4087', 'volume_name': 'volume-7630e6c1-17d2-4ed8-a735-2e86103e4087', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15126531-bc79-4c01-b554-1450b739f360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15126531-bc79-4c01-b554-1450b739f360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f67864d-3d46-4bf0-9078-8f24cb965a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Volume 7630e6c1-17d2-4ed8-a735-2e86103e4087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7630e6c1-17d2-4ed8-a735-2e86103e4087', 'volume_size': 1} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-479760660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7630e6c1-17d2-4ed8-a735-2e86103e4087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc0894d64024d8a9e0293a72fe1d487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:03Z,use_quota=True,user_id='c65ee1adc64a4415b467da6edf4a8507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Creating volume 7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:03 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:03 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 1073741824 Jul 10 00:45:03 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Flow 'volume_create_manager' (6169b4fb-212a-4b56-96db-99bad14cc8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d33457-256b-4faf-a67d-54535c98a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d33457-256b-4faf-a67d-54535c98a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2119116396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec32d2688e7a4d78af5ddd0122bd2ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:04Z,use_quota=True,user_id='d591fba950ef403793e9073ac811ced7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cffed6-edf9-48cb-a2a9-9db19554f9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cffed6-edf9-48cb-a2a9-9db19554f9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d762c65-4783-41fe-8d20-ca25e29b5767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d762c65-4783-41fe-8d20-ca25e29b5767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c', 'volume_name': 'volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee6d679-04a6-46ce-becf-51b06377edbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee6d679-04a6-46ce-becf-51b06377edbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff806b7c-fe89-4cd7-959f-1395e495a5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Volume 3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c', 'volume_size': 1} Jul 10 00:45:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:04 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 1073741824" returned: 0 in 0.895s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:04 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 Jul 10 00:45:04 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:05 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087" returned: 0 in 0.614s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2119116396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec32d2688e7a4d78af5ddd0122bd2ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:04Z,use_quota=True,user_id='d591fba950ef403793e9073ac811ced7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Creating volume 3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:05 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f67864d-3d46-4bf0-9078-8f24cb965a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7630e6c1-17d2-4ed8-a735-2e86103e4087', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:05 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c 1073741824 Jul 10 00:45:05 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b94a2b-56ac-4879-9645-c78ea51f500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:05 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Volume volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 (7630e6c1-17d2-4ed8-a735-2e86103e4087): created successfully Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b94a2b-56ac-4879-9645-c78ea51f500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Flow 'volume_create_manager' (531338eb-9d2d-445e-887f-94999753f16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1f0a6a02-c185-4e83-b4fc-a8f45af225aa tempest-VolumesCloneTest-2138445343 None] Created volume successfully. Jul 10 00:45:06 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c 1073741824" returned: 0 in 1.087s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:06 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c Jul 10 00:45:06 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Flow 'volume_create_manager' (48b19e47-30b5-4a3f-ab38-b2a742c2602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b63351-0532-4eba-8475-72615abb1861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b63351-0532-4eba-8475-72615abb1861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1075138239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6838dd-80fe-4f39-803b-97acd852779a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc0894d64024d8a9e0293a72fe1d487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7630e6c1-17d2-4ed8-a735-2e86103e4087,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:06Z,use_quota=True,user_id='c65ee1adc64a4415b467da6edf4a8507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed41b90-44bc-4a5e-99ea-16bde5a55c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed41b90-44bc-4a5e-99ea-16bde5a55c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb995f44-1e2c-4e58-b17c-c3288e8a4678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb995f44-1e2c-4e58-b17c-c3288e8a4678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8c6838dd-80fe-4f39-803b-97acd852779a', 'volume_name': 'volume-8c6838dd-80fe-4f39-803b-97acd852779a', 'volume_size': 2, 'source_volid': '7630e6c1-17d2-4ed8-a735-2e86103e4087', 'source_volstatus': 'available'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d159a68f-b92c-4f21-ae58-8b2d6bdd1f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d159a68f-b92c-4f21-ae58-8b2d6bdd1f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18052e7a-93af-4963-bfa9-040ef23416fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:06 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Volume 8c6838dd-80fe-4f39-803b-97acd852779a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8c6838dd-80fe-4f39-803b-97acd852779a', 'volume_size': 2, 'source_volid': '7630e6c1-17d2-4ed8-a735-2e86103e4087', 'source_volstatus': 'available'} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:06 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c" returned: 0 in 0.764s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.562s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:06 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Cloning volume 7630e6c1-17d2-4ed8-a735-2e86103e4087 to volume 8c6838dd-80fe-4f39-803b-97acd852779a Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff806b7c-fe89-4cd7-959f-1395e495a5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11efc0ca-6c5e-4f74-81f4-6c7a6efabec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:06 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Volume volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c (3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c): created successfully Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11efc0ca-6c5e-4f74-81f4-6c7a6efabec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Flow 'volume_create_manager' (6169b4fb-212a-4b56-96db-99bad14cc8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Creating offline snapshot eefa575d-a316-4539-8704-46628dcba454 of volume 7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:45:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-175f0287-50d1-438a-8bfe-ee47aa479341 tempest-VolumesTestJSON-669999223 None] Created volume successfully. Jul 10 00:45:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a48e877-d555-4e52-8c7a-55112f835220]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:07 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 Jul 10 00:45:07 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:07 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087" returned: 0 in 0.796s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:07 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 1G Jul 10 00:45:07 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:08 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 1G" returned: 0 in 1.031s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:08 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 Jul 10 00:45:08 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Acquiring lock "cinder-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Lock "cinder-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Acquiring lock "cinder-quobyte-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Lock "cinder-quobyte-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c15d29d-9f03-45d1-973f-5b1b23e3d009]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:09 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c Jul 10 00:45:09 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:09 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454" returned: 0 in 0.933s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:09 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 is being set with open permissions: ugo+rw Jul 10 00:45:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:09 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 Jul 10 00:45:09 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:10 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c" returned: 0 in 0.864s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:10 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c Jul 10 00:45:10 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:10 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454" returned: 0 in 0.761s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:10 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.info Jul 10 00:45:10 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:11 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c" returned: 0 in 0.910s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Lock "cinder-quobyte-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c" released by "delete_volume" :: held 1.838s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:11 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.info" returned: 0 in 0.740s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:11 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.info is being set with open permissions: ugo+rw Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Created reservations ['77678325-ee52-49f3-8fe9-50c300db6c47', 'af765c40-8cc8-4d08-87e5-1aea77be61cd', '8f4f8988-686f-4933-83be-dfa2f7cf8b81', 'be2589ab-5baf-436b-baeb-eda4bac37a00'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:11 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.info Jul 10 00:45:11 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:11 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:11 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Acquiring lock "cinder-6610a224-64eb-44e2-9f9c-70f33fb95cc1-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Lock "cinder-6610a224-64eb-44e2-9f9c-70f33fb95cc1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Acquiring lock "cinder-quobyte-6610a224-64eb-44e2-9f9c-70f33fb95cc1" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Lock "cinder-quobyte-6610a224-64eb-44e2-9f9c-70f33fb95cc1" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9182d3-61ab-4be4-aea4-d15a5d888aed]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:12 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 Jul 10 00:45:12 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:12 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.info" returned: 0 in 1.146s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "cinder-quobyte-8c6838dd-80fe-4f39-803b-97acd852779a" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-8c6838dd-80fe-4f39-803b-97acd852779a" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] snapshot: eefa575d-a316-4539-8704-46628dcba454, volume: 8c6838dd-80fe-4f39-803b-97acd852779a, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dc8cc0-77f0-445b-82ba-ded72dee0072]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:12 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 Jul 10 00:45:12 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:12 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.542s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:12 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Deleted volume successfully. Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-738a7f5d-3ab6-4cd4-b3e6-ca7537b3261c tempest-VolumesTestJSON-669999223 None] Lock "cinder-3d7aa2e9-2579-4888-9d0e-c7260b9dfa5c-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:13 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1" returned: 0 in 1.316s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:13 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1 Jul 10 00:45:13 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:13 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454" returned: 0 in 0.961s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7630e6c1-17d2-4ed8-a735-2e86103e4087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd282f1b-15c2-43dc-9ace-d6d820edd3b7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:13 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 Jul 10 00:45:13 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:13 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6610a224-64eb-44e2-9f9c-70f33fb95cc1" returned: 0 in 0.741s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Lock "cinder-quobyte-6610a224-64eb-44e2-9f9c-70f33fb95cc1" released by "delete_volume" :: held 2.151s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Created reservations ['1500b14e-0e53-43dd-bbca-7398ec2e1f6d', 'e92eb4ea-1c3f-4df5-94a3-f9bbf4a0dd97', 'b69f583d-50dc-4e5c-8017-36dc6a05acae', 'd4d3e112-caca-4365-8c3c-7c532274c21e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:14 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:14 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:14 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087" returned: 0 in 0.975s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:14 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a Jul 10 00:45:14 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:14 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.655s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Deleted volume successfully. Jul 10 00:45:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1399795b-0e98-4907-ae7e-62cef05bb5c9 tempest-VolumesTestJSON-669999223 None] Lock "cinder-6610a224-64eb-44e2-9f9c-70f33fb95cc1-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Acquiring lock "cinder-c75e4f7f-c761-4429-bcef-9a64bdbab3a4-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Lock "cinder-c75e4f7f-c761-4429-bcef-9a64bdbab3a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Acquiring lock "cinder-quobyte-c75e4f7f-c761-4429-bcef-9a64bdbab3a4" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Lock "cinder-quobyte-c75e4f7f-c761-4429-bcef-9a64bdbab3a4" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de54fd0-c7fa-4eda-b109-92c2a4418311]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:15 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 Jul 10 00:45:15 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:17 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4" returned: 0 in 2.036s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:17 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4 Jul 10 00:45:17 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:19 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c75e4f7f-c761-4429-bcef-9a64bdbab3a4" returned: 0 in 1.880s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Lock "cinder-quobyte-c75e4f7f-c761-4429-bcef-9a64bdbab3a4" released by "delete_volume" :: held 3.985s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Created reservations ['5db7c0de-1d20-47f2-9609-f8683bf54a79', '8c512985-35d8-4d17-92b0-fffcbf890029', '67f3f639-ce2b-44cf-80a2-1dc06df9104c', '861f8f2a-5fb7-4f82-8a28-1eb0e7cda628'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:19 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:19 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:21 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.761s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:21 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Deleted volume successfully. Jul 10 00:45:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e80155f-514f-43e1-8c80-6becf588db12 tempest-VolumesTestJSON-669999223 None] Lock "cinder-c75e4f7f-c761-4429-bcef-9a64bdbab3a4-delete_volume" released by "delete_volume" :: held 6.481s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:21 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a" returned: 0 in 7.136s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:21 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[38067187-7fef-4e3b-84fe-64129ae87e39]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:21 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 Jul 10 00:45:21 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:22 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087" returned: 0 in 0.943s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:22 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:45:22 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Converted 1024.00 MB image at 143.48 MB/s Jul 10 00:45:22 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a is being set with open permissions: ugo+rw Jul 10 00:45:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:22 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a Jul 10 00:45:22 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:23 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a" returned: 0 in 0.679s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-8c6838dd-80fe-4f39-803b-97acd852779a" released by "_copy_volume_from_snapshot" :: held 10.843s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "cinder-quobyte-eefa575d-a316-4539-8704-46628dcba454" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-eefa575d-a316-4539-8704-46628dcba454" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Deleting offline snapshot eefa575d-a316-4539-8704-46628dcba454 of volume 7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] snapshot_file for this snap is: volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d07e5-9418-4612-8300-260c899dbef5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:23 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 Jul 10 00:45:23 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:24 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454" returned: 0 in 0.824s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7630e6c1-17d2-4ed8-a735-2e86103e4087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:45:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c2f71-d5d6-48de-b710-7d3bbf784dfb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:24 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 Jul 10 00:45:24 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:25 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087" returned: 0 in 0.793s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:25 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 Jul 10 00:45:25 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5139e1e7-4213-4b93-899b-1a7d3d75de78 tempest-GroupSnapshotsV319Test-2091626379 None] Group tempest-GroupSnapshotsV319Test-Group-681731762: creating Jul 10 00:45:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5139e1e7-4213-4b93-899b-1a7d3d75de78 tempest-GroupSnapshotsV319Test-2091626379 None] Group tempest-GroupSnapshotsV319Test-Group-681731762: created successfully Jul 10 00:45:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5139e1e7-4213-4b93-899b-1a7d3d75de78 tempest-GroupSnapshotsV319Test-2091626379 None] Create group completed successfully. Jul 10 00:45:25 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:25 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454 Jul 10 00:45:25 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:26 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087.eefa575d-a316-4539-8704-46628dcba454" returned: 0 in 0.726s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-eefa575d-a316-4539-8704-46628dcba454" released by "_delete_snapshot" :: held 3.218s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.749s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18052e7a-93af-4963-bfa9-040ef23416fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6838dd-80fe-4f39-803b-97acd852779a', 'volume_size': 2, 'source_volid': '7630e6c1-17d2-4ed8-a735-2e86103e4087', 'source_volstatus': 'available'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cfb64e-173f-48e2-bd9a-7bc2194e62b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:26 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Volume volume-8c6838dd-80fe-4f39-803b-97acd852779a (8c6838dd-80fe-4f39-803b-97acd852779a): created successfully Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cfb64e-173f-48e2-bd9a-7bc2194e62b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Flow 'volume_create_manager' (48b19e47-30b5-4a3f-ab38-b2a742c2602f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5d4c72ed-df20-4701-baf8-3c0afb4cdf24 tempest-VolumesCloneTest-2138445343 None] Created volume successfully. Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Flow 'volume_create_manager' (ea1a6ba3-0fc7-4001-b9c3-a57e2cd9f3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32eb4c1-e92e-4a30-a931-08baac7fb687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32eb4c1-e92e-4a30-a931-08baac7fb687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1403291805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db806338-73a1-4076-ae76-13d70602b5c8,host='devstack@QuobyteHD#QuobyteHD',id=a596e010-458c-4e51-badd-5a391cf29ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa3bc8b4e8de4abdad69cfc4f4819978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:27Z,use_quota=True,user_id='f86c994b4b7c4857b3a5cb9f35865470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2503f24c-a9c9-4ff7-98f8-c3fbc8499b79),volume_type_id=2503f24c-a9c9-4ff7-98f8-c3fbc8499b79)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64964d90-4290-4c9d-b336-8c3ada103a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64964d90-4290-4c9d-b336-8c3ada103a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06f068a-c045-44d1-a44c-afd82c9147ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06f068a-c045-44d1-a44c-afd82c9147ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a596e010-458c-4e51-badd-5a391cf29ef7', 'volume_name': 'volume-a596e010-458c-4e51-badd-5a391cf29ef7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62fad05-9b5e-4c4e-9dce-2293ac5b8a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62fad05-9b5e-4c4e-9dce-2293ac5b8a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2fbae1-b596-4bc9-b658-0a1ad2fbd012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:26 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Volume a596e010-458c-4e51-badd-5a391cf29ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a596e010-458c-4e51-badd-5a391cf29ef7', 'volume_size': 1} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db806338-73a1-4076-ae76-13d70602b5c8,created_at=2026-07-09T22:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1403291805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db806338-73a1-4076-ae76-13d70602b5c8,host='devstack@QuobyteHD#QuobyteHD',id=a596e010-458c-4e51-badd-5a391cf29ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa3bc8b4e8de4abdad69cfc4f4819978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:27Z,use_quota=True,user_id='f86c994b4b7c4857b3a5cb9f35865470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2503f24c-a9c9-4ff7-98f8-c3fbc8499b79),volume_type_id=2503f24c-a9c9-4ff7-98f8-c3fbc8499b79)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Creating volume a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:26 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:45:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:26 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 1073741824 Jul 10 00:45:26 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "cinder-8c6838dd-80fe-4f39-803b-97acd852779a-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-8c6838dd-80fe-4f39-803b-97acd852779a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "cinder-quobyte-8c6838dd-80fe-4f39-803b-97acd852779a" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-8c6838dd-80fe-4f39-803b-97acd852779a" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d580ff3-12bb-4cfd-8ff8-6f82eb116015]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:27 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a Jul 10 00:45:27 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:27 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 1073741824" returned: 0 in 0.967s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:27 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 Jul 10 00:45:27 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:28 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a" returned: 0 in 0.870s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:28 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a Jul 10 00:45:28 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:28 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7" returned: 0 in 0.678s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2fbae1-b596-4bc9-b658-0a1ad2fbd012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a596e010-458c-4e51-badd-5a391cf29ef7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e76920a-21aa-428b-9617-420a09c773dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Volume volume-a596e010-458c-4e51-badd-5a391cf29ef7 (a596e010-458c-4e51-badd-5a391cf29ef7): created successfully Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e76920a-21aa-428b-9617-420a09c773dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Flow 'volume_create_manager' (ea1a6ba3-0fc7-4001-b9c3-a57e2cd9f3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:28 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f6bd906f-9a28-49e7-96d5-c53c0dde614b tempest-GroupSnapshotsV319Test-2091626379 None] Created volume successfully. Jul 10 00:45:28 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-8c6838dd-80fe-4f39-803b-97acd852779a" returned: 0 in 0.661s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-8c6838dd-80fe-4f39-803b-97acd852779a" released by "delete_volume" :: held 1.579s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Created reservations ['94e21a24-ea10-4943-9051-106474f24d53', '1cfd8ae4-09e5-4158-b15e-cb67ccff5ba5', 'a431d593-043e-4eae-8e4e-551fb245b94d', '5c3ad272-4e2f-48ed-ad12-f7859a7a98e3'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:29 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:29 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] GroupSnapshot 6151dae6-892b-4a27-992d-11cc33f7f91f: creating. Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Group snapshot 6151dae6-892b-4a27-992d-11cc33f7f91f: creating. {{(pid=87452) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Creating offline snapshot e9d8dca4-bd4a-4580-a63b-20ededbe83f8 of volume a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6b0bb-bc76-4f3a-b662-f32f03b208d6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "cinder-7630e6c1-17d2-4ed8-a735-2e86103e4087-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-7630e6c1-17d2-4ed8-a735-2e86103e4087-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "cinder-quobyte-7630e6c1-17d2-4ed8-a735-2e86103e4087" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-7630e6c1-17d2-4ed8-a735-2e86103e4087" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:29 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 Jul 10 00:45:29 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:29 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.780s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Deleted volume successfully. Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15367e6-9dcf-478c-9cb4-26905f7d8a81]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6b4531b4-0c1e-46eb-b0d4-4d16396d5b11 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-8c6838dd-80fe-4f39-803b-97acd852779a-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:29 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 Jul 10 00:45:29 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:30 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7" returned: 0 in 0.847s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:30 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 1G Jul 10 00:45:30 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:30 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087" returned: 0 in 0.847s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:30 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087 Jul 10 00:45:30 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:31 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-7630e6c1-17d2-4ed8-a735-2e86103e4087" returned: 0 in 0.656s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-quobyte-7630e6c1-17d2-4ed8-a735-2e86103e4087" released by "delete_volume" :: held 1.596s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:31 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 1G" returned: 0 in 0.919s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a596e010-458c-4e51-badd-5a391cf29ef7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Created reservations ['d33a5cd7-0410-494d-b850-3589d9953b6a', 'ee9c6d13-813a-40de-8158-81f35c2ed2dd', '0d3f313b-8dae-4046-9a88-282e7ae38772', 'b21f0524-3830-476a-a44c-231139538b22'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:31 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a596e010-458c-4e51-badd-5a391cf29ef7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 Jul 10 00:45:31 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:31 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:31 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:32 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a596e010-458c-4e51-badd-5a391cf29ef7 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8" returned: 0 in 0.735s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:32 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:45:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:32 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 Jul 10 00:45:32 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:32 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.714s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Deleted volume successfully. Jul 10 00:45:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c8717de3-762c-4585-ad8d-c72685d7fdf9 tempest-VolumesCloneTest-2138445343 None] Lock "cinder-7630e6c1-17d2-4ed8-a735-2e86103e4087-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:32 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8" returned: 0 in 0.731s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:32 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.info Jul 10 00:45:32 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:33 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.info" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:33 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:45:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:33 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.info Jul 10 00:45:33 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:34 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.info" returned: 0 in 0.695s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.753s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cb7574ce-2ece-4d6d-bb5c-df18fbc84dd4 tempest-GroupSnapshotsV319Test-2091626379 None] group_snapshot 6151dae6-892b-4a27-992d-11cc33f7f91f: created successfully Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Flow 'volume_create_manager' (2d55b6f0-4b31-4310-adec-d7b58e910a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37a90ea-ba25-4593-84ab-e5c24f2ec925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] group_snapshot 6151dae6-892b-4a27-992d-11cc33f7f91f: deleting Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37a90ea-ba25-4593-84ab-e5c24f2ec925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1105800498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55319e0c-e49d-4999-83af-0ef3d3249377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c314c42dca40e58315cd8cc6fadcb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:35Z,use_quota=True,user_id='40e8bf822abf497ab59be4636a143e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4300b8-7c4e-468b-8069-c8ec9f9894fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4300b8-7c4e-468b-8069-c8ec9f9894fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff41f12d-9816-4ced-8a83-05c719bc825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] group_snapshot 6151dae6-892b-4a27-992d-11cc33f7f91f: deleting {{(pid=87452) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Acquiring lock "cinder-quobyte-a596e010-458c-4e51-badd-5a391cf29ef7" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Lock "cinder-quobyte-a596e010-458c-4e51-badd-5a391cf29ef7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Acquiring lock "cinder-quobyte-e9d8dca4-bd4a-4580-a63b-20ededbe83f8" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Lock "cinder-quobyte-e9d8dca4-bd4a-4580-a63b-20ededbe83f8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Deleting offline snapshot e9d8dca4-bd4a-4580-a63b-20ededbe83f8 of volume a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] snapshot_file for this snap is: volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f186cd67-99df-4435-820c-74358000d9a2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:35 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 Jul 10 00:45:35 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff41f12d-9816-4ced-8a83-05c719bc825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55319e0c-e49d-4999-83af-0ef3d3249377', 'volume_name': 'volume-55319e0c-e49d-4999-83af-0ef3d3249377', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1533125b-eb15-4bbd-a408-f93af880cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1533125b-eb15-4bbd-a408-f93af880cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0d2fd9-7fbf-4480-b7a9-65da08d81757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:35 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Volume 55319e0c-e49d-4999-83af-0ef3d3249377: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55319e0c-e49d-4999-83af-0ef3d3249377', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:45:35 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Trying to clone 55319e0c-e49d-4999-83af-0ef3d3249377 from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-cbecaac1-7103-48e8-874a-3b5539d8ea67 req-dc8cb088-9309-441a-886f-79d7acc94b56 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-cbecaac1-7103-48e8-874a-3b5539d8ea67 req-dc8cb088-9309-441a-886f-79d7acc94b56 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:45:36 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[88226d06-043f-43ca-84ac-edb2853d00a0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-cbecaac1-7103-48e8-874a-3b5539d8ea67 req-dc8cb088-9309-441a-886f-79d7acc94b56 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[67741476-66e3-4bf9-be20-aba0a7f66c2a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:36 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 Jul 10 00:45:36 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:36 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD Jul 10 00:45:36 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:36 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8" returned: 0 in 0.860s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a596e010-458c-4e51-badd-5a391cf29ef7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae151c3-b679-4f0c-bf37-0b4be95bf608]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:36 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 Jul 10 00:45:36 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:36 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:36 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 is fetched for user 40e8bf822abf497ab59be4636a143e9a. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-cbecaac1-7103-48e8-874a-3b5539d8ea67 req-dc8cb088-9309-441a-886f-79d7acc94b56 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9" returned: 0 in 0.814s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-cbecaac1-7103-48e8-874a-3b5539d8ea67 req-dc8cb088-9309-441a-886f-79d7acc94b56 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-cbecaac1-7103-48e8-874a-3b5539d8ea67 req-dc8cb088-9309-441a-886f-79d7acc94b56 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f23710c5-533d-454f-9c56-64f31883b297', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e55c2fb-8b59-4d20-8982-5b32f6ff585a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-cbecaac1-7103-48e8-874a-3b5539d8ea67 req-dc8cb088-9309-441a-886f-79d7acc94b56 tempest-TestServerVolumeAttachmentScenario-1944342677 None] attachment_update completed successfully. Jul 10 00:45:37 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD Jul 10 00:45:37 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:37 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7" returned: 0 in 0.857s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:37 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 Jul 10 00:45:37 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:37 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1105800498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55319e0c-e49d-4999-83af-0ef3d3249377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c314c42dca40e58315cd8cc6fadcb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:35Z,use_quota=True,user_id='40e8bf822abf497ab59be4636a143e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Creating volume 55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:37 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:37 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 1073741824 Jul 10 00:45:37 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:37 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8" returned: 0 in 0.854s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:38 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8 Jul 10 00:45:38 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:38 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7.e9d8dca4-bd4a-4580-a63b-20ededbe83f8" returned: 0 in 0.699s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Lock "cinder-quobyte-e9d8dca4-bd4a-4580-a63b-20ededbe83f8" released by "_delete_snapshot" :: held 3.382s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:38 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 1073741824" returned: 0 in 0.943s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Lock "cinder-quobyte-a596e010-458c-4e51-badd-5a391cf29ef7" released by "delete_snapshot" :: held 3.422s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:38 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:38 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:38 devstack cinder-volume[87452]: WARNING cinder.quota [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-802392245 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-802392245, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:45:38 devstack cinder-volume[87452]: WARNING cinder.quota [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-802392245 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-802392245, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:45:38 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] Created reservations ['4e0cdf1c-3009-4288-a7cd-515f86d6247a', 'f9e96f08-f01c-44d3-9568-fb20c2d6211c', 'bb1533f4-eb7c-430a-a1ce-a9c7cbbf83f0', 'e2decdfd-06ec-4a1f-b7d2-84e0b3aeb469'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:38 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b8285222-d4ba-47a6-8289-f5ab8e80765d tempest-GroupSnapshotsV319Test-2091626379 None] group_snapshot 6151dae6-892b-4a27-992d-11cc33f7f91f: deleted successfully Jul 10 00:45:39 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 0 in 0.664s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Attempting download of 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 55319e0c-e49d-4999-83af-0ef3d3249377. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da22bfb-e5c8-4dcd-939c-89e260377cdd]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_dm4gz9xi {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:39 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_dm4gz9xi Jul 10 00:45:39 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Acquiring lock "cinder-quobyte-a596e010-458c-4e51-badd-5a391cf29ef7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Lock "cinder-quobyte-a596e010-458c-4e51-badd-5a391cf29ef7" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d5efa-14fc-4c87-be53-b4c9711f43dd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:40 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 Jul 10 00:45:40 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:40 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_dm4gz9xi" returned: 0 in 0.738s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_dm4gz9xi {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:40 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_dm4gz9xi Jul 10 00:45:40 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:40 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7" returned: 0 in 0.802s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:40 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7 Jul 10 00:45:40 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:40 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_dm4gz9xi" returned: 1 in 0.738s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_dm4gz9xi' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c462067-6f81-42c2-b288-44e57495ab2f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:41 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD Jul 10 00:45:41 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:41 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a596e010-458c-4e51-badd-5a391cf29ef7" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Lock "cinder-quobyte-a596e010-458c-4e51-badd-5a391cf29ef7" released by "delete_volume" :: held 1.585s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Created reservations ['7adefebf-a97b-44e1-b472-ae859448475a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:41 devstack cinder-volume[87452]: WARNING cinder.quota [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-802392245 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-802392245, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Created reservations ['f0701ee7-4e29-4545-972b-212cc607cf80', '86f3f0b7-247d-4904-9899-d90bc452cb10', '20e517aa-359d-4760-9621-51d51123eaed', '8b7a9853-f92c-4024-8d3c-b1904b58c84e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:41 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:41 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:41 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] 2b7c4d0c-270c-4121-95ac-c2aa29014583 was qcow2, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:45:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:41 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:41 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:42 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.720s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:42 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:42 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-432c38ea-dfbe-405a-9c63-9aaeeeb21350 tempest-GroupSnapshotsV319Test-2091626379 None] Delete group completed successfully. Jul 10 00:45:44 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 0 in 2.385s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:44 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_fgxq08yidevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:45:44 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Converted 112.00 MB image at 46.95 MB/s Jul 10 00:45:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:44 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 1G Jul 10 00:45:44 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:44 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 1G" returned: 0 in 0.789s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[869100ff-0250-4237-b6fc-72dca2aed5d3]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:45 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:45 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:45 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 0 in 0.873s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:45 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:45 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:46 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 1 in 0.865s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Downloaded image 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 55319e0c-e49d-4999-83af-0ef3d3249377 successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 for user 40e8bf822abf497ab59be4636a143e9a is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Marking volume 55319e0c-e49d-4999-83af-0ef3d3249377 as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=93,cinder:UPDATE=119,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Copying metadata from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 to 55319e0c-e49d-4999-83af-0ef3d3249377. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Creating volume glance metadata for volume 55319e0c-e49d-4999-83af-0ef3d3249377 backed by image 2b7c4d0c-270c-4121-95ac-c2aa29014583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=106,cinder:DELETE=11,cinder:SELECT=87,cinder:INSERT=30 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0d2fd9-7fbf-4480-b7a9-65da08d81757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55319e0c-e49d-4999-83af-0ef3d3249377', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee4dd4c-250c-48e7-a526-1cda9443ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Volume volume-55319e0c-e49d-4999-83af-0ef3d3249377 (55319e0c-e49d-4999-83af-0ef3d3249377): created successfully Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee4dd4c-250c-48e7-a526-1cda9443ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Flow 'volume_create_manager' (2d55b6f0-4b31-4310-adec-d7b58e910a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:46 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-41b45d32-4cd8-4425-8962-2ca0ce36836d tempest-VolumesExtendTest-701321489 None] Created volume successfully. Jul 10 00:45:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:48 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdc8b8e-d9ce-41bd-82d9-4bd38f1a0322]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:48 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:48 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ca58b403-3253-42c5-811e-5a4bd607c1a9 req-cea9bb12-d7bb-4552-bb45-96098acfcd7b tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:49 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 0 in 0.842s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:49 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:49 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:49 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 1 in 0.790s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 2G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 2G" returned: 0 in 0.076s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.788s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ca58b403-3253-42c5-811e-5a4bd607c1a9 req-cea9bb12-d7bb-4552-bb45-96098acfcd7b tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.905s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[57877f98-2049-42ee-ad6d-98709e315840]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ca58b403-3253-42c5-811e-5a4bd607c1a9 req-cea9bb12-d7bb-4552-bb45-96098acfcd7b tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:50 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a96bccdd-64f4-4db7-9b76-f88bf10df60d tempest-VolumesExtendTest-701321489 None] Extend volume completed successfully. Jul 10 00:45:50 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e Jul 10 00:45:50 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Acquiring lock "cinder-55319e0c-e49d-4999-83af-0ef3d3249377-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Lock "cinder-55319e0c-e49d-4999-83af-0ef3d3249377-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Acquiring lock "cinder-quobyte-55319e0c-e49d-4999-83af-0ef3d3249377" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-55319e0c-e49d-4999-83af-0ef3d3249377" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24d9c53-0124-4687-90d3-056bea901cf9]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:50 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:50 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:50 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ca58b403-3253-42c5-811e-5a4bd607c1a9 req-cea9bb12-d7bb-4552-bb45-96098acfcd7b tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e" returned: 0 in 0.991s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ca58b403-3253-42c5-811e-5a4bd607c1a9 req-cea9bb12-d7bb-4552-bb45-96098acfcd7b tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ca58b403-3253-42c5-811e-5a4bd607c1a9 req-cea9bb12-d7bb-4552-bb45-96098acfcd7b tempest-TestServerVolumeAttachmentScenario-1944342677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-20360ab0-984f-4462-808e-3e019259da3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '906943b2-8a7a-4d5e-a044-50c1fcffd4de', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:45:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-ca58b403-3253-42c5-811e-5a4bd607c1a9 req-cea9bb12-d7bb-4552-bb45-96098acfcd7b tempest-TestServerVolumeAttachmentScenario-1944342677 None] attachment_update completed successfully. Jul 10 00:45:51 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 0 in 0.791s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:51 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:51 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:52 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 1 in 0.967s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:52 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377 Jul 10 00:45:52 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:53 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-55319e0c-e49d-4999-83af-0ef3d3249377" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-55319e0c-e49d-4999-83af-0ef3d3249377" released by "delete_volume" :: held 2.660s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Created reservations ['71511f3a-d4fb-4ae0-8a02-ae00f2a0299c', '8aeb2096-f8b7-44c4-a31c-64ebe0637f10', 'f6766157-1f87-4be2-b96a-6ae1c2eda572', '9971ca00-d214-424d-904f-00e61e7fcd7d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:53 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:53 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:53 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:45:53 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:54 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.780s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:54 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Deleted volume successfully. Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b349ef65-f558-4546-9312-b59f86e276f0 tempest-VolumesExtendTest-701321489 None] Lock "cinder-55319e0c-e49d-4999-83af-0ef3d3249377-delete_volume" released by "delete_volume" :: held 3.719s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:54 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.795s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Flow 'volume_create_manager' (45faea1b-444f-4a28-b3cf-43075dac9fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab2ed69-34a2-4263-a4da-5f6e382959f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab2ed69-34a2-4263-a4da-5f6e382959f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-614183306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b9595c-ccab-42aa-a547-781e8316d4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c314c42dca40e58315cd8cc6fadcb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:55Z,use_quota=True,user_id='40e8bf822abf497ab59be4636a143e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff84a81c-550b-418e-9ed2-d5eb409f27b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff84a81c-550b-418e-9ed2-d5eb409f27b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb5c326-4970-46fa-9379-2f32abf1011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb5c326-4970-46fa-9379-2f32abf1011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b9595c-ccab-42aa-a547-781e8316d4d9', 'volume_name': 'volume-d6b9595c-ccab-42aa-a547-781e8316d4d9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31e9fbc-5e2b-42f8-bd6d-d0230301bd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31e9fbc-5e2b-42f8-bd6d-d0230301bd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a06633-a914-4482-8472-baf35aea8a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Volume d6b9595c-ccab-42aa-a547-781e8316d4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b9595c-ccab-42aa-a547-781e8316d4d9', 'volume_size': 1} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-614183306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b9595c-ccab-42aa-a547-781e8316d4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c314c42dca40e58315cd8cc6fadcb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:55Z,use_quota=True,user_id='40e8bf822abf497ab59be4636a143e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Creating volume d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:54 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:45:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:54 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 1073741824 Jul 10 00:45:54 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:55 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 1073741824" returned: 0 in 1.122s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:55 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 Jul 10 00:45:55 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:56 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9" returned: 0 in 0.758s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a06633-a914-4482-8472-baf35aea8a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b9595c-ccab-42aa-a547-781e8316d4d9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1ea6be-db4e-49d7-8793-b2919e2f14f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Volume volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 (d6b9595c-ccab-42aa-a547-781e8316d4d9): created successfully Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1ea6be-db4e-49d7-8793-b2919e2f14f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Flow 'volume_create_manager' (45faea1b-444f-4a28-b3cf-43075dac9fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f9f5b765-a73c-48a4-a65c-fdc4967f4768 tempest-VolumesExtendTest-701321489 None] Created volume successfully. Jul 10 00:45:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-48d5001c-1907-4425-bd38-b476ae2fc560 req-ea77c23d-fd2c-4c38-9873-b617f7b84ccd tempest-TestServerVolumeAttachmentScenario-1944342677 None] Terminate volume connection completed successfully. Jul 10 00:45:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-48d5001c-1907-4425-bd38-b476ae2fc560 req-ea77c23d-fd2c-4c38-9873-b617f7b84ccd tempest-TestServerVolumeAttachmentScenario-1944342677 None] Deleting attachment 906943b2-8a7a-4d5e-a044-50c1fcffd4de. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:45:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Creating offline snapshot 1b8674a8-6f25-4b4a-bc1f-7c2726942d8d of volume d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:45:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54db917-1b37-46d9-a939-6d3ca1e01cf4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:58 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 Jul 10 00:45:58 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:58 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9" returned: 0 in 0.797s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:58 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d 1G Jul 10 00:45:58 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:59 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d 1G" returned: 0 in 0.894s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:59 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d Jul 10 00:45:59 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:00 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" returned: 0 in 0.755s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:00 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d is being set with open permissions: ugo+rw Jul 10 00:46:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:00 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d Jul 10 00:46:00 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-fe24f829-53cf-40f1-adc2-2f7a038a0e9a req-75983590-2218-47fd-9c23-164e629b43b8 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Terminate volume connection completed successfully. Jul 10 00:46:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-fe24f829-53cf-40f1-adc2-2f7a038a0e9a req-75983590-2218-47fd-9c23-164e629b43b8 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Deleting attachment f23710c5-533d-454f-9c56-64f31883b297. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:46:01 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" returned: 0 in 0.701s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:01 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.info Jul 10 00:46:01 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:01 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.info" returned: 0 in 0.711s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:01 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.info is being set with open permissions: ugo+rw Jul 10 00:46:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:01 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.info Jul 10 00:46:01 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:02 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.info" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.813s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b47324fd-7dd9-4320-b0fe-f61f37645d08 tempest-VolumesExtendTest-701321489 None] Create snapshot completed successfully Jul 10 00:46:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[86486fe0-c7a6-4213-96d9-2ddfce980fdd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:03 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 Jul 10 00:46:03 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:04 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9" returned: 0 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d 2G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d 2G" returned: 0 in 0.174s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.039s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7071cc9d-6342-45ab-85db-db94e5a7b68a tempest-VolumesExtendTest-701321489 None] Extend volume completed successfully. Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Acquiring lock "cinder-1b8674a8-6f25-4b4a-bc1f-7c2726942d8d-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Lock "cinder-1b8674a8-6f25-4b4a-bc1f-7c2726942d8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Acquiring lock "cinder-quobyte-d6b9595c-ccab-42aa-a547-781e8316d4d9" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-d6b9595c-ccab-42aa-a547-781e8316d4d9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Acquiring lock "cinder-quobyte-1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Deleting offline snapshot 1b8674a8-6f25-4b4a-bc1f-7c2726942d8d of volume d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] snapshot_file for this snap is: volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf77d19c-dc87-46b7-983d-5ae5b34aa243]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Flow 'volume_create_manager' (c1a90225-932e-480b-9986-424afc141ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0616fd2-1184-4cec-bf58-e834734d73ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:06 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d Jul 10 00:46:06 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0616fd2-1184-4cec-bf58-e834734d73ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-126964667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80ded4b-2860-41c9-b866-e055b16c97af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4dd735ac2249279819cdb478ab8a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:06Z,use_quota=True,user_id='0a2066c0c7dc4c17a80d63376422df59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6681bce-8704-4c55-b1ac-62495b0efe5e),volume_type_id=e6681bce-8704-4c55-b1ac-62495b0efe5e)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29519296-175e-4397-aaab-f32c7678972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29519296-175e-4397-aaab-f32c7678972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e65250-92a1-4295-a9c4-a5372713dd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e65250-92a1-4295-a9c4-a5372713dd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80ded4b-2860-41c9-b866-e055b16c97af', 'volume_name': 'volume-c80ded4b-2860-41c9-b866-e055b16c97af', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1553b619-d2ea-410f-91e5-095210b0a965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1553b619-d2ea-410f-91e5-095210b0a965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3cfedc-ec65-48a0-9178-6526ea2c50ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:06 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Volume c80ded4b-2860-41c9-b866-e055b16c97af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80ded4b-2860-41c9-b866-e055b16c97af', 'volume_size': 1} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-126964667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80ded4b-2860-41c9-b866-e055b16c97af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4dd735ac2249279819cdb478ab8a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:06Z,use_quota=True,user_id='0a2066c0c7dc4c17a80d63376422df59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6681bce-8704-4c55-b1ac-62495b0efe5e),volume_type_id=e6681bce-8704-4c55-b1ac-62495b0efe5e)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Creating volume c80ded4b-2860-41c9-b866-e055b16c97af {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:06 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:06 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af 1073741824 Jul 10 00:46:06 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:06 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" returned: 0 in 1.051s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b9595c-ccab-42aa-a547-781e8316d4d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[001d5581-22dd-4e66-92b7-fb0d29828eec]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:07 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 Jul 10 00:46:07 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:07 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af 1073741824" returned: 0 in 0.998s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:07 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af Jul 10 00:46:07 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:07 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9" returned: 0 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:07 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d Jul 10 00:46:07 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:07 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af" returned: 0 in 0.687s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3cfedc-ec65-48a0-9178-6526ea2c50ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80ded4b-2860-41c9-b866-e055b16c97af', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811dbf05-631a-41ec-9684-6a5b3842a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:07 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Volume volume-c80ded4b-2860-41c9-b866-e055b16c97af (c80ded4b-2860-41c9-b866-e055b16c97af): created successfully Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811dbf05-631a-41ec-9684-6a5b3842a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Flow 'volume_create_manager' (c1a90225-932e-480b-9986-424afc141ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a0b44c01-c012-4a3c-8953-492f7679a48e tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Created volume successfully. Jul 10 00:46:08 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" returned: 0 in 0.860s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:08 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d Jul 10 00:46:08 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:09 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9.1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" returned: 0 in 0.637s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-1b8674a8-6f25-4b4a-bc1f-7c2726942d8d" released by "_delete_snapshot" :: held 3.516s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-d6b9595c-ccab-42aa-a547-781e8316d4d9" released by "delete_snapshot" :: held 3.559s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Created reservations ['b4742eac-90c5-4bea-accf-a30587e30dbf', '3a13843e-287f-41eb-bd0c-3d8e7de32f1d', 'faa4c4eb-9ebf-43d8-a3ff-6044627ec21c', '51a3791b-a6d1-4578-8ebb-895c1685831e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Delete snapshot completed successfully. Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bab5408-152d-403b-9d2e-f72a349d6c2d tempest-VolumesExtendTest-701321489 None] Lock "cinder-1b8674a8-6f25-4b4a-bc1f-7c2726942d8d-delete_snapshot" released by "delete_snapshot" :: held 3.816s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:09 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:09 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Acquiring lock "cinder-d6b9595c-ccab-42aa-a547-781e8316d4d9-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Lock "cinder-d6b9595c-ccab-42aa-a547-781e8316d4d9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Acquiring lock "cinder-quobyte-d6b9595c-ccab-42aa-a547-781e8316d4d9" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-d6b9595c-ccab-42aa-a547-781e8316d4d9" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[357fc7d9-c710-4800-b4a4-66f91e011bcc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:10 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 Jul 10 00:46:10 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:10 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.762s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3b496930-112e-463d-b27a-c36029402048 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Retype volume completed successfully. Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Acquiring lock "cinder-c80ded4b-2860-41c9-b866-e055b16c97af-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "cinder-c80ded4b-2860-41c9-b866-e055b16c97af-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Acquiring lock "cinder-quobyte-c80ded4b-2860-41c9-b866-e055b16c97af" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "cinder-20360ab0-984f-4462-808e-3e019259da3e-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "cinder-quobyte-c80ded4b-2860-41c9-b866-e055b16c97af" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-20360ab0-984f-4462-808e-3e019259da3e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5cff9f-cb9d-4152-acad-0a35c97f9435]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "cinder-quobyte-20360ab0-984f-4462-808e-3e019259da3e" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-quobyte-20360ab0-984f-4462-808e-3e019259da3e" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc2968c-4f84-4c0b-8bf0-07ff2b2e43e1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af Jul 10 00:46:11 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9" returned: 0 in 0.804s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9 Jul 10 00:46:11 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e Jul 10 00:46:11 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af" returned: 0 in 0.792s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af Jul 10 00:46:11 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d6b9595c-ccab-42aa-a547-781e8316d4d9" returned: 0 in 0.708s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Lock "cinder-quobyte-d6b9595c-ccab-42aa-a547-781e8316d4d9" released by "delete_volume" :: held 1.610s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:11 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e" returned: 0 in 0.792s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Created reservations ['38359a72-d59c-43cb-a8cc-803be30526d8', '20160c48-fe78-4f5d-9c80-294a81804cae', '3e6f8f38-58a0-4b49-b9f2-03a81323e048', 'aa76703e-87f8-48e5-9e57-06a164f14a75'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:11 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:12 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:12 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:12 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c80ded4b-2860-41c9-b866-e055b16c97af" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "cinder-quobyte-c80ded4b-2860-41c9-b866-e055b16c97af" released by "delete_volume" :: held 1.585s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:12 devstack cinder-volume[87452]: WARNING cinder.quota [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:46:12 devstack cinder-volume[87452]: WARNING cinder.quota [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:46:12 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20360ab0-984f-4462-808e-3e019259da3e" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-quobyte-20360ab0-984f-4462-808e-3e019259da3e" released by "delete_volume" :: held 1.564s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Created reservations ['6ee5eb85-7b0f-40dc-94d8-b0322dd4f122', '9f36f6b1-01d6-4728-9e59-ef7ae50b5f21', '15daafec-c814-4829-a79f-aed23269970c', '2e84f984-5237-416a-9adc-53f13da8b78d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:12 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.689s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Deleted volume successfully. Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Created reservations ['d926cb24-c049-4aa6-9c10-e2fceba2161b', 'b2e2177c-b67e-4056-9889-dc3321e6b91f', 'eb5890fd-9771-4b85-a3af-e722862b6f8f', 'c7c07e76-bb67-442a-8c5a-07a7fef57569'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-db1fe430-113b-46a7-9cc0-c90cdf233cd4 tempest-VolumesExtendTest-701321489 None] Lock "cinder-d6b9595c-ccab-42aa-a547-781e8316d4d9-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:12 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:12 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:12 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:12 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "cinder-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "cinder-quobyte-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-quobyte-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694d835-ef24-437c-acb9-0ed2e6efcf72]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:13 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 Jul 10 00:46:13 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:13 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.944s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Deleted volume successfully. Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a5cba41f-7841-4eba-a311-a40a872a8787 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-20360ab0-984f-4462-808e-3e019259da3e-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:13 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.111s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Deleted volume successfully. Jul 10 00:46:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d1fc71ce-ad62-4d34-99f7-4e550ff4d4c2 tempest-VolumeRetypeWithoutMigrationTest-1289525950 None] Lock "cinder-c80ded4b-2860-41c9-b866-e055b16c97af-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:14 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9" returned: 0 in 0.915s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:14 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9 Jul 10 00:46:14 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:15 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9" returned: 0 in 0.741s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-quobyte-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9" released by "delete_volume" :: held 1.722s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Created reservations ['a6cd16aa-7416-4c66-895f-d275365496bc', '30813c4e-74cf-49c5-a02f-83cff28751a7', 'f8503b90-c89b-4007-b31e-415905cceb3b', '2d236154-c2b3-4d25-91c8-41a5d7e903f0'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:15 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:15 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:16 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.770s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Deleted volume successfully. Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2420866a-5a56-4674-8af9-38de587bdbc5 tempest-TestServerVolumeAttachmentScenario-1944342677 None] Lock "cinder-0409cb42-32b4-48fe-9fa1-3b8c457cf4c9-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (b645b491-7dcc-40bf-9cde-4421355f7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac616210-c01c-4f16-a0b6-26a2ae2db0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac616210-c01c-4f16-a0b6-26a2ae2db0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435289232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e891e2-dcb6-4c44-bbc8-f6010a35f502,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:16Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe02a994-1866-4e14-84d9-47ac81a344b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe02a994-1866-4e14-84d9-47ac81a344b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa3f5fd-a4d6-42ce-b6a1-2897a0e98f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa3f5fd-a4d6-42ce-b6a1-2897a0e98f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e891e2-dcb6-4c44-bbc8-f6010a35f502', 'volume_name': 'volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bcbadb-079b-4dbe-a42b-4cd672b6fc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bcbadb-079b-4dbe-a42b-4cd672b6fc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e49088-5c77-414d-9c9f-e868b101f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:16 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Volume 61e891e2-dcb6-4c44-bbc8-f6010a35f502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502', 'volume_size': 1} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-435289232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e891e2-dcb6-4c44-bbc8-f6010a35f502,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:16Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Creating volume 61e891e2-dcb6-4c44-bbc8-f6010a35f502 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:16 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:16 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 1073741824 Jul 10 00:46:16 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:17 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 1073741824" returned: 0 in 1.021s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:17 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 Jul 10 00:46:17 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:18 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502" returned: 0 in 0.702s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e49088-5c77-414d-9c9f-e868b101f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6cd3fd-4c51-4063-844d-d34ac42ad5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Volume volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 (61e891e2-dcb6-4c44-bbc8-f6010a35f502): created successfully Jul 10 00:46:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6cd3fd-4c51-4063-844d-d34ac42ad5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (b645b491-7dcc-40bf-9cde-4421355f7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:18 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b81b8ce8-f469-423e-834b-7dc5bdb567ed tempest-VolumesGetTest-557915747 None] Created volume successfully. Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (828de4be-758b-40a7-a20c-d99eae02b76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef55e5f-b828-4e5c-92a6-8508fe03e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef55e5f-b828-4e5c-92a6-8508fe03e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-359440715',display_name='tempest-VolumesGetTest-Volume-2090668380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fdb97-9d4a-4942-aa67-a4b4eed018c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:19Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9d03ee-d396-45da-b320-3f1da27ecc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9d03ee-d396-45da-b320-3f1da27ecc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6401c93-1c16-41ea-ad5c-6484f21ebcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6401c93-1c16-41ea-ad5c-6484f21ebcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783fdb97-9d4a-4942-aa67-a4b4eed018c6', 'volume_name': 'volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819e3963-898d-4624-91e5-e0b631bb3195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819e3963-898d-4624-91e5-e0b631bb3195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53bad69-66f5-45da-817b-7629b8063092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Volume 783fdb97-9d4a-4942-aa67-a4b4eed018c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6', 'volume_size': 1} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-359440715',display_name='tempest-VolumesGetTest-Volume-2090668380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fdb97-9d4a-4942-aa67-a4b4eed018c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:19Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Creating volume 783fdb97-9d4a-4942-aa67-a4b4eed018c6 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:19 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:19 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 1073741824 Jul 10 00:46:19 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:20 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 1073741824" returned: 0 in 1.001s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:20 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 Jul 10 00:46:20 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Flow 'volume_create_manager' (e1c05844-a369-4ae6-bcad-91b2164f6e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d5525a-e64f-46c5-847a-f89a8d0c2837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d5525a-e64f-46c5-847a-f89a8d0c2837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1762429486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425616a280c04d689351e9a9f08c4783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:21Z,use_quota=True,user_id='2beb60a6c153424096b6d29ce17f771e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(709c9133-e804-4cab-b285-cc75c46bcaf6),volume_type_id=709c9133-e804-4cab-b285-cc75c46bcaf6)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff75b267-c608-468c-abfb-96ded4638522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff75b267-c608-468c-abfb-96ded4638522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4cca28-814c-4899-a64f-97db73e433a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4cca28-814c-4899-a64f-97db73e433a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d', 'volume_name': 'volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e70cb3-ddad-4761-bcc0-96dc543f5cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e70cb3-ddad-4761-bcc0-96dc543f5cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2add90f4-18fe-4b7e-b4be-5562c529329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:20 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Volume 1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d', 'volume_size': 1} Jul 10 00:46:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:21 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6" returned: 0 in 0.691s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1762429486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425616a280c04d689351e9a9f08c4783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:21Z,use_quota=True,user_id='2beb60a6c153424096b6d29ce17f771e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(709c9133-e804-4cab-b285-cc75c46bcaf6),volume_type_id=709c9133-e804-4cab-b285-cc75c46bcaf6)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Creating volume 1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:21 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:21 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d 1073741824 Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53bad69-66f5-45da-817b-7629b8063092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:21 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68454e9e-d712-4d8a-99a6-f47d328998b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:21 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Volume volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 (783fdb97-9d4a-4942-aa67-a4b4eed018c6): created successfully Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68454e9e-d712-4d8a-99a6-f47d328998b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (828de4be-758b-40a7-a20c-d99eae02b76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6f2aa0f5-f475-48e7-9ab1-2e2a8860ba50 tempest-VolumesGetTest-557915747 None] Created volume successfully. Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-783fdb97-9d4a-4942-aa67-a4b4eed018c6-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Lock "cinder-783fdb97-9d4a-4942-aa67-a4b4eed018c6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-783fdb97-9d4a-4942-aa67-a4b4eed018c6" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-783fdb97-9d4a-4942-aa67-a4b4eed018c6" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d231c79e-3a95-44c3-ae6a-5b6a8d97ecb9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:21 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 Jul 10 00:46:21 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:22 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d 1073741824" returned: 0 in 0.982s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:22 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d Jul 10 00:46:22 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:22 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6" returned: 0 in 0.850s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:22 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6 Jul 10 00:46:22 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:22 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d" returned: 0 in 0.831s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2add90f4-18fe-4b7e-b4be-5562c529329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2fbf59-af19-4027-92c9-f45a2238a7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:22 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Volume volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d (1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d): created successfully Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2fbf59-af19-4027-92c9-f45a2238a7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Flow 'volume_create_manager' (e1c05844-a369-4ae6-bcad-91b2164f6e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5798692e-acfb-4d25-9991-1ff79b296dc5 tempest-VolumeTypesAccessTest-990794303 None] Created volume successfully. Jul 10 00:46:23 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-783fdb97-9d4a-4942-aa67-a4b4eed018c6" returned: 0 in 0.784s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-783fdb97-9d4a-4942-aa67-a4b4eed018c6" released by "delete_volume" :: held 1.691s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Created reservations ['9c136671-e603-433e-ae06-0dca861a1287', '09998011-e5d5-4a3c-9bda-86e4d9e49451', '32fa5469-b6e4-49fd-9979-2aa9c010f10f', 'e695dd55-ed4a-4c02-8d9b-19e8455dfd98'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:23 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:23 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-61e891e2-dcb6-4c44-bbc8-f6010a35f502-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Lock "cinder-61e891e2-dcb6-4c44-bbc8-f6010a35f502-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-61e891e2-dcb6-4c44-bbc8-f6010a35f502" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-61e891e2-dcb6-4c44-bbc8-f6010a35f502" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Acquiring lock "cinder-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Lock "cinder-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f0a28-dd51-4a61-a318-b1deb9c1d8a3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Acquiring lock "cinder-quobyte-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Lock "cinder-quobyte-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12e75fe-fd9e-43d8-b6e4-a2e29037f898]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:24 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 Jul 10 00:46:24 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:24 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:24 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Deleted volume successfully. Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a4ae0c32-89e1-437c-9b26-c08c543b0750 tempest-VolumesGetTest-557915747 None] Lock "cinder-783fdb97-9d4a-4942-aa67-a4b4eed018c6-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:24 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d Jul 10 00:46:24 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:24 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502" returned: 0 in 0.864s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:24 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502 Jul 10 00:46:24 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:24 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d" returned: 0 in 0.842s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:24 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d Jul 10 00:46:24 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:25 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-61e891e2-dcb6-4c44-bbc8-f6010a35f502" returned: 0 in 0.809s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:25 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d" returned: 0 in 0.727s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-61e891e2-dcb6-4c44-bbc8-f6010a35f502" released by "delete_volume" :: held 1.753s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Lock "cinder-quobyte-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d" released by "delete_volume" :: held 1.629s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:25 devstack cinder-volume[87452]: WARNING cinder.quota [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1129284573 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1129284573, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:46:25 devstack cinder-volume[87452]: WARNING cinder.quota [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1129284573 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1129284573, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Created reservations ['38716687-f31a-47d0-bb69-9ddd0cb7a30e', '57509571-9ee6-4f7e-a1e6-ba39acf23980', '829373b0-2b87-4414-b734-52bd52951ad2', '96c677ac-ebd6-4e99-9712-5ffc3f283f71'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Created reservations ['acae0bf7-5391-43f0-802b-45cfd5cb4551', 'acc23595-5b22-4450-ac9d-77c1fc27eb18', '8209ea18-cfeb-4be3-a692-693c72425504', '0fa125a5-55bb-4d5c-8158-1bdf4bc82ad1'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:25 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:25 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:25 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:25 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:26 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.858s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Deleted volume successfully. Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e494bfbf-862f-415b-8234-f729418fc408 tempest-VolumesGetTest-557915747 None] Lock "cinder-61e891e2-dcb6-4c44-bbc8-f6010a35f502-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:26 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (d650b49a-bcba-4f1f-97cd-426465f63eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9409b0-1e00-4bfd-9809-915e25e1c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.947s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Deleted volume successfully. Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9409b0-1e00-4bfd-9809-915e25e1c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-196774690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be05d56-bae0-40f8-87f3-81107534ccf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:27Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9bb2f1-2c9c-469b-93f2-07ee3f1a8a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9bb2f1-2c9c-469b-93f2-07ee3f1a8a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b17581-641f-4a95-b424-925f5b8d3280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b17581-641f-4a95-b424-925f5b8d3280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be05d56-bae0-40f8-87f3-81107534ccf3', 'volume_name': 'volume-2be05d56-bae0-40f8-87f3-81107534ccf3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ae8021-9373-4dca-a021-a0da825d984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ae8021-9373-4dca-a021-a0da825d984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fc23eb-764e-4352-8494-af8cd5d29456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:26 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Volume 2be05d56-bae0-40f8-87f3-81107534ccf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be05d56-bae0-40f8-87f3-81107534ccf3', 'volume_size': 1} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-196774690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be05d56-bae0-40f8-87f3-81107534ccf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:27Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Creating volume 2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:26 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5cc3e0cd-225c-495c-810d-4e88d95c9496 tempest-VolumeTypesAccessTest-990794303 None] Lock "cinder-1ba5bf7a-8068-4c9c-bdcf-cd07ea37eb9d-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:26 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 1073741824 Jul 10 00:46:26 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:27 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 1073741824" returned: 0 in 0.999s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:27 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 Jul 10 00:46:27 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:28 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fc23eb-764e-4352-8494-af8cd5d29456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be05d56-bae0-40f8-87f3-81107534ccf3', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfef7dc3-a8bb-424e-95df-f58af595f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:28 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Volume volume-2be05d56-bae0-40f8-87f3-81107534ccf3 (2be05d56-bae0-40f8-87f3-81107534ccf3): created successfully Jul 10 00:46:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfef7dc3-a8bb-424e-95df-f58af595f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:28 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (d650b49a-bcba-4f1f-97cd-426465f63eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:28 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-526be90a-79f2-4e92-8a3e-e5ac6cf8a5fe tempest-VolumesGetTest-557915747 None] Created volume successfully. Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (2126c2f3-89a0-409f-8c11-886c074d26fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e23ee77-0225-4eef-ae59-b2f4ffbcf690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e23ee77-0225-4eef-ae59-b2f4ffbcf690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-226706383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35c3a51-4119-4021-a574-6d29830189b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2be05d56-bae0-40f8-87f3-81107534ccf3,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:29Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43430f0-632f-4260-92af-9b9385f70b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43430f0-632f-4260-92af-9b9385f70b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104c323c-3cf1-4f4d-a759-c1b6dce50ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104c323c-3cf1-4f4d-a759-c1b6dce50ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b35c3a51-4119-4021-a574-6d29830189b1', 'volume_name': 'volume-b35c3a51-4119-4021-a574-6d29830189b1', 'volume_size': 1, 'source_volid': '2be05d56-bae0-40f8-87f3-81107534ccf3', 'source_volstatus': 'available'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cefd446-385f-434e-8105-3e02eaeac015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cefd446-385f-434e-8105-3e02eaeac015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b0fffb-485a-4eb7-8c60-e691bf01055f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Volume b35c3a51-4119-4021-a574-6d29830189b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b35c3a51-4119-4021-a574-6d29830189b1', 'volume_size': 1, 'source_volid': '2be05d56-bae0-40f8-87f3-81107534ccf3', 'source_volstatus': 'available'} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:29 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Cloning volume 2be05d56-bae0-40f8-87f3-81107534ccf3 to volume b35c3a51-4119-4021-a574-6d29830189b1 Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Creating offline snapshot 51021664-7e8d-495e-9f33-88e14e9e6c8a of volume 2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2687b3-c667-41a2-bf91-b9b4e7bbb5f6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:29 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 Jul 10 00:46:29 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:30 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3" returned: 0 in 0.884s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:30 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a 1G Jul 10 00:46:30 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:31 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a 1G" returned: 0 in 0.957s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2be05d56-bae0-40f8-87f3-81107534ccf3 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:31 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2be05d56-bae0-40f8-87f3-81107534ccf3 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a Jul 10 00:46:31 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:32 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2be05d56-bae0-40f8-87f3-81107534ccf3 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a" returned: 0 in 0.848s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:32 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a is being set with open permissions: ugo+rw Jul 10 00:46:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:32 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a Jul 10 00:46:32 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:33 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a" returned: 0 in 0.765s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:33 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.info Jul 10 00:46:33 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:34 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.info" returned: 0 in 0.897s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:34 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.info is being set with open permissions: ugo+rw Jul 10 00:46:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:34 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.info Jul 10 00:46:34 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:34 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.info" returned: 0 in 0.886s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-b35c3a51-4119-4021-a574-6d29830189b1" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-b35c3a51-4119-4021-a574-6d29830189b1" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] snapshot: 51021664-7e8d-495e-9f33-88e14e9e6c8a, volume: b35c3a51-4119-4021-a574-6d29830189b1, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f451c73-415d-4b32-b821-e19c607ccb82]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:35 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a Jul 10 00:46:35 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:35 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a" returned: 0 in 0.877s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2be05d56-bae0-40f8-87f3-81107534ccf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb67d0f-0e23-4e06-aac9-f803b43115de]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:36 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 Jul 10 00:46:36 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:36 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3" returned: 0 in 0.948s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:36 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:46:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:36 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 Jul 10 00:46:36 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:42 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1" returned: 0 in 5.628s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:42 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a48a17-6d11-47a1-b274-1e8470f81ab1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:42 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 Jul 10 00:46:42 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:43 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:INSERT=28,cinder:SELECT=85,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:46:43 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=92,cinder:INSERT=29,cinder:UPDATE=99,cinder:DELETE=8 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:46:43 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3" returned: 0 in 1.070s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:43 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:46:43 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Converted 1024.00 MB image at 181.91 MB/s Jul 10 00:46:43 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 is being set with open permissions: ugo+rw Jul 10 00:46:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:43 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 Jul 10 00:46:43 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:44 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1" returned: 0 in 0.694s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-b35c3a51-4119-4021-a574-6d29830189b1" released by "_copy_volume_from_snapshot" :: held 9.326s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-51021664-7e8d-495e-9f33-88e14e9e6c8a" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-51021664-7e8d-495e-9f33-88e14e9e6c8a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Deleting offline snapshot 51021664-7e8d-495e-9f33-88e14e9e6c8a of volume 2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] snapshot_file for this snap is: volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916ce48-3b32-4fb5-a00e-6e437346fc61]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:44 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a Jul 10 00:46:44 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:45 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a" returned: 0 in 1.043s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2be05d56-bae0-40f8-87f3-81107534ccf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[002af5d0-e35b-41f0-ac46-37a0c467ba83]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Flow 'volume_create_manager' (b26e1c18-b845-48e8-90ae-0848c9f478ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ae4fb6-ac2e-4cd2-b7ad-9c19ba6f0c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ae4fb6-ac2e-4cd2-b7ad-9c19ba6f0c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1191880624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10368db8-d87b-4f37-a3c5-16667bb3cff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f6cf2f36c348e9b12ec12dc0ba6868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:45Z,use_quota=True,user_id='37211d6726c2486abea489c392e33921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7219503b-ce1a-4193-8ab4-bc7cb1de3c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7219503b-ce1a-4193-8ab4-bc7cb1de3c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f13795b-33a6-46d0-8b84-e46547722623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f13795b-33a6-46d0-8b84-e46547722623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10368db8-d87b-4f37-a3c5-16667bb3cff6', 'volume_name': 'volume-10368db8-d87b-4f37-a3c5-16667bb3cff6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 Jul 10 00:46:45 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac2956-6838-44c1-a782-52f11fc73a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac2956-6838-44c1-a782-52f11fc73a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe2385e-cd99-4947-9787-c3c4a9011b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Volume 10368db8-d87b-4f37-a3c5-16667bb3cff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10368db8-d87b-4f37-a3c5-16667bb3cff6', 'volume_size': 1} Jul 10 00:46:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:46 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3" returned: 0 in 0.802s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:46 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a Jul 10 00:46:46 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:47 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a" returned: 0 in 0.749s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:47 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a Jul 10 00:46:47 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:47 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3.51021664-7e8d-495e-9f33-88e14e9e6c8a" returned: 0 in 0.776s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-51021664-7e8d-495e-9f33-88e14e9e6c8a" released by "_delete_snapshot" :: held 3.515s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.296s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.271s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1191880624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10368db8-d87b-4f37-a3c5-16667bb3cff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f6cf2f36c348e9b12ec12dc0ba6868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:45Z,use_quota=True,user_id='37211d6726c2486abea489c392e33921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Creating volume 10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:47 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:48 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 1073741824 Jul 10 00:46:48 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b0fffb-485a-4eb7-8c60-e691bf01055f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35c3a51-4119-4021-a574-6d29830189b1', 'volume_size': 1, 'source_volid': '2be05d56-bae0-40f8-87f3-81107534ccf3', 'source_volstatus': 'available'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae26813-3bfe-4e10-90a0-915182d9fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Volume volume-b35c3a51-4119-4021-a574-6d29830189b1 (b35c3a51-4119-4021-a574-6d29830189b1): created successfully Jul 10 00:46:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae26813-3bfe-4e10-90a0-915182d9fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (2126c2f3-89a0-409f-8c11-886c074d26fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8fe90e74-5a0a-4b98-8ca7-b0ee2b7183e8 tempest-VolumesGetTest-557915747 None] Created volume successfully. Jul 10 00:46:48 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 1073741824" returned: 0 in 0.919s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:48 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 Jul 10 00:46:48 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:49 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6" returned: 0 in 0.722s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:49 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebe2385e-cd99-4947-9787-c3c4a9011b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10368db8-d87b-4f37-a3c5-16667bb3cff6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f300f7a-5c59-418a-bbc1-3189511567b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:49 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Volume volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 (10368db8-d87b-4f37-a3c5-16667bb3cff6): created successfully Jul 10 00:46:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f300f7a-5c59-418a-bbc1-3189511567b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Flow 'volume_create_manager' (b26e1c18-b845-48e8-90ae-0848c9f478ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:49 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5dc4a6f8-e8a6-43dc-9423-401efa5e913a tempest-SnapshotMetadataTestJSON-2070845127 None] Created volume successfully. Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (90784aa9-3d9e-4567-a517-dc402d8bfc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21653b1e-89b3-4359-9faf-ee6d62559491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21653b1e-89b3-4359-9faf-ee6d62559491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1870905225',display_name='tempest-VolumesGetTest-Volume-1622720009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52793b9-e5d6-41c0-a452-8d0a8d234d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:50Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c06ff6-b750-489d-bac7-79dac664c251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c06ff6-b750-489d-bac7-79dac664c251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c76516-70c8-4741-8d80-ec0adcadb96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c76516-70c8-4741-8d80-ec0adcadb96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52793b9-e5d6-41c0-a452-8d0a8d234d99', 'volume_name': 'volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86028d1-297b-4d4d-a40e-8d8f14e8c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86028d1-297b-4d4d-a40e-8d8f14e8c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f16825f-d468-4913-af63-eab1df2d66f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:50 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Volume c52793b9-e5d6-41c0-a452-8d0a8d234d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99', 'volume_size': 1} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1870905225',display_name='tempest-VolumesGetTest-Volume-1622720009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52793b9-e5d6-41c0-a452-8d0a8d234d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:50Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Creating volume c52793b9-e5d6-41c0-a452-8d0a8d234d99 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:50 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:50 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 1073741824 Jul 10 00:46:50 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:51 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 1073741824" returned: 0 in 1.000s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:51 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 Jul 10 00:46:51 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:51 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99" returned: 0 in 0.677s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.910s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Creating offline snapshot b6507819-2a14-46f3-a7b0-38264cc9ba93 of volume 10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f16825f-d468-4913-af63-eab1df2d66f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b783b8a-1719-47da-b0b5-927eb74088ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[64206b3c-82e1-49d9-841e-264a550574d9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:51 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Volume volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 (c52793b9-e5d6-41c0-a452-8d0a8d234d99): created successfully Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b783b8a-1719-47da-b0b5-927eb74088ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:51 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (90784aa9-3d9e-4567-a517-dc402d8bfc6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-33c6fae1-4eef-4e46-91c8-5255dcb94981 tempest-VolumesGetTest-557915747 None] Created volume successfully. Jul 10 00:46:52 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 Jul 10 00:46:52 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-c52793b9-e5d6-41c0-a452-8d0a8d234d99-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Lock "cinder-c52793b9-e5d6-41c0-a452-8d0a8d234d99-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-c52793b9-e5d6-41c0-a452-8d0a8d234d99" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-c52793b9-e5d6-41c0-a452-8d0a8d234d99" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef53c6-6870-4847-883f-885781a902d4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:52 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 Jul 10 00:46:52 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:52 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6" returned: 0 in 0.855s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:52 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 1G Jul 10 00:46:52 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:53 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99" returned: 0 in 0.823s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:53 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99 Jul 10 00:46:53 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:53 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:53 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:53 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 1G" returned: 0 in 0.934s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:53 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 Jul 10 00:46:53 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:54 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c52793b9-e5d6-41c0-a452-8d0a8d234d99" returned: 0 in 0.762s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-c52793b9-e5d6-41c0-a452-8d0a8d234d99" released by "delete_volume" :: held 1.635s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Created reservations ['e805fd1d-f963-45c2-aeeb-67972086c121', 'f52111af-4d75-4b2a-8b6a-e12a7f204b0d', '7aa161b1-3094-4281-958d-fc6bb8e8e358', '1187a1ea-db3e-4ca1-9ffd-e67a1124b5cd'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:54 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:54 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:54 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.803s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:46:54 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93" returned: 0 in 0.759s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:54 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 is being set with open permissions: ugo+rw Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:54 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 Jul 10 00:46:54 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-b35c3a51-4119-4021-a574-6d29830189b1-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Lock "cinder-b35c3a51-4119-4021-a574-6d29830189b1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-b35c3a51-4119-4021-a574-6d29830189b1" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-b35c3a51-4119-4021-a574-6d29830189b1" acquired by "delete_volume" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7867da5f-8367-4195-a0fc-a564fc9bb9b0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:54 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 Jul 10 00:46:54 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:55 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.806s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Deleted volume successfully. Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c2569c0b-f8f4-4dcb-af7e-1521efe6a82d tempest-VolumesGetTest-557915747 None] Lock "cinder-c52793b9-e5d6-41c0-a452-8d0a8d234d99-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:55 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93" returned: 0 in 0.750s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:55 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.info Jul 10 00:46:55 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Flow 'volume_create_manager' (233546aa-7859-4409-9e06-225fa8a75bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871d99ac-1bb3-4b46-ac8e-077689fab270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871d99ac-1bb3-4b46-ac8e-077689fab270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-396391706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04353fd3-99fe-4da0-98e3-bb8a7073b61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0656d46dc0941438fa32cab18ce38c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:56Z,use_quota=True,user_id='0daeccfa9be74df68d58798d982f87ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8abcf1-5ce1-4187-905e-6c009b27f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8abcf1-5ce1-4187-905e-6c009b27f98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d1e61b-080e-495d-9c66-9cddf1acb6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:46:55 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1" returned: 0 in 0.884s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:55 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1 Jul 10 00:46:55 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:55 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.info" returned: 0 in 0.699s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:55 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.info is being set with open permissions: ugo+rw Jul 10 00:46:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:55 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.info Jul 10 00:46:55 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d1e61b-080e-495d-9c66-9cddf1acb6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04353fd3-99fe-4da0-98e3-bb8a7073b61b', 'volume_name': 'volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1404a548-3e42-4b31-ba5f-8af39f4324f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1404a548-3e42-4b31-ba5f-8af39f4324f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102bbaed-0f06-4a5f-9e16-a3c8ccb6dbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Volume 04353fd3-99fe-4da0-98e3-bb8a7073b61b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Trying to clone 04353fd3-99fe-4da0-98e3-bb8a7073b61b from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:46:56 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:46:56 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b35c3a51-4119-4021-a574-6d29830189b1" returned: 0 in 0.723s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-b35c3a51-4119-4021-a574-6d29830189b1" released by "delete_volume" :: held 1.650s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b3e60-9c16-4e6b-b912-871dd22172ff]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Created reservations ['b807c493-9d9a-474a-b222-48da0e9d4226', '28aca0f5-5fc4-4223-839c-075bc2ad3332', '0d49c0bd-f215-4d5a-a3f9-3c5fdf3c5c67', '6da1bee2-7ca8-4faa-9870-bb04a690501f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:56 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD Jul 10 00:46:56 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:56 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:56 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:56 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.info" returned: 0 in 0.741s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.840s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-9d011afe-4e70-4c5e-ac68-d208a0a76ba4 tempest-SnapshotMetadataTestJSON-2070845127 None] Create snapshot completed successfully Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-2be05d56-bae0-40f8-87f3-81107534ccf3-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Lock "cinder-2be05d56-bae0-40f8-87f3-81107534ccf3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-2be05d56-bae0-40f8-87f3-81107534ccf3" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-2be05d56-bae0-40f8-87f3-81107534ccf3" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b7ca0e-6875-485d-9368-f63ba7fcfc83]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:57 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 is fetched for user 0daeccfa9be74df68d58798d982f87ae. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:46:57 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 Jul 10 00:46:57 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:57 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.733s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Deleted volume successfully. Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-eed0f437-17a9-48a9-b449-2263f0ca3f72 tempest-VolumesGetTest-557915747 None] Lock "cinder-b35c3a51-4119-4021-a574-6d29830189b1-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8d516e-077a-4dc9-87c5-d7615d6162b0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:57 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD Jul 10 00:46:57 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "cinder-b6507819-2a14-46f3-a7b0-38264cc9ba93-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-b6507819-2a14-46f3-a7b0-38264cc9ba93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "cinder-quobyte-10368db8-d87b-4f37-a3c5-16667bb3cff6" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-quobyte-10368db8-d87b-4f37-a3c5-16667bb3cff6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "cinder-quobyte-b6507819-2a14-46f3-a7b0-38264cc9ba93" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-quobyte-b6507819-2a14-46f3-a7b0-38264cc9ba93" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Deleting offline snapshot b6507819-2a14-46f3-a7b0-38264cc9ba93 of volume 10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] snapshot_file for this snap is: volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:46:58 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3" returned: 0 in 0.876s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df71c90-6e3b-4565-b3ef-d6bdee2f7c1b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:58 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3 Jul 10 00:46:58 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:58 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 Jul 10 00:46:58 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:58 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-396391706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04353fd3-99fe-4da0-98e3-bb8a7073b61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0656d46dc0941438fa32cab18ce38c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:56Z,use_quota=True,user_id='0daeccfa9be74df68d58798d982f87ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Creating volume 04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:58 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:58 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b 1073741824 Jul 10 00:46:58 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:58 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2be05d56-bae0-40f8-87f3-81107534ccf3" returned: 0 in 0.668s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-2be05d56-bae0-40f8-87f3-81107534ccf3" released by "delete_volume" :: held 1.612s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Created reservations ['c54e076b-9437-4899-b0cb-574469a6b2a5', '73f0a07a-2777-4d8d-88c6-ca55637f3373', 'a7cb0f2f-9f89-4957-b552-7b4f373fcbc3', 'f1265c77-c21d-4f6e-9236-c5151054a42b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:58 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93" returned: 0 in 0.822s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10368db8-d87b-4f37-a3c5-16667bb3cff6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:58 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:46:58 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50bc1c7-1e93-4b09-9811-7ff6c90aa773]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:59 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 Jul 10 00:46:59 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:59 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b 1073741824" returned: 0 in 0.872s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:59 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:46:59 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:59 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.715s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:59 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Deleted volume successfully. Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-981054ea-4c81-49b0-a547-d9e5fb26ec72 tempest-VolumesGetTest-557915747 None] Lock "cinder-2be05d56-bae0-40f8-87f3-81107534ccf3-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:59 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6" returned: 0 in 0.859s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:59 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 Jul 10 00:46:59 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:59 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 0 in 0.759s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:59 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Attempting download of 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 04353fd3-99fe-4da0-98e3-bb8a7073b61b. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9eec2-d66f-4a17-bf4f-1cfbc34b1c6c]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_5mi0b269 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (c5f17567-8c63-48ec-bc5d-cb1c0e14efe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494c5101-6a85-489a-809c-7bcec37d99c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_5mi0b269 Jul 10 00:47:00 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494c5101-6a85-489a-809c-7bcec37d99c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-855109987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d4f544-bf43-4eba-892f-4783534bb81a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:00Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74909a5f-dcd4-4476-85cd-4bd664a8ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74909a5f-dcd4-4476-85cd-4bd664a8ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e632a26-f4fb-4167-8ec1-681a0be36c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e632a26-f4fb-4167-8ec1-681a0be36c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82d4f544-bf43-4eba-892f-4783534bb81a', 'volume_name': 'volume-82d4f544-bf43-4eba-892f-4783534bb81a', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317edd22-f05e-416c-84bc-ec94f8b681d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317edd22-f05e-416c-84bc-ec94f8b681d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8715f4be-d467-4424-befb-56375c309dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Volume 82d4f544-bf43-4eba-892f-4783534bb81a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82d4f544-bf43-4eba-892f-4783534bb81a', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Trying to clone 82d4f544-bf43-4eba-892f-4783534bb81a from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:47:00 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93" returned: 0 in 0.873s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:00 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93 Jul 10 00:47:00 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:47:00 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:47:00 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_5mi0b269" returned: 0 in 0.768s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_5mi0b269 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9529c2e8-b9c7-4807-b861-27044391d637]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:00 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_5mi0b269 Jul 10 00:47:00 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:00 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD Jul 10 00:47:00 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:01 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6.b6507819-2a14-46f3-a7b0-38264cc9ba93" returned: 0 in 0.715s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-quobyte-b6507819-2a14-46f3-a7b0-38264cc9ba93" released by "_delete_snapshot" :: held 3.390s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-quobyte-10368db8-d87b-4f37-a3c5-16667bb3cff6" released by "delete_snapshot" :: held 3.417s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Created reservations ['f65f7544-ab6b-4baa-86de-91d6a67bfbe7', '64e56341-afed-4e19-87b8-6541539e4ab6', 'b141ee2c-acc0-4ebe-a24f-cff2a6092339', 'f8377114-6288-4e97-8f7e-8585dcd3a39d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:01 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_5mi0b269" returned: 1 in 0.756s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_5mi0b269' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[44755a7f-ab0d-4c4f-b24f-dbfac1bdd4a1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:01 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 is fetched for user c733649efaf74b46ae0440540025669c. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:47:01 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Delete snapshot completed successfully. Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d2e3f153-8b41-4d78-956d-df707a3888b7 tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-b6507819-2a14-46f3-a7b0-38264cc9ba93-delete_snapshot" released by "delete_snapshot" :: held 3.585s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a03dd8-f8c9-4d01-af31-ba1ddaa9b511]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:01 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD Jul 10 00:47:01 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:01 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD Jul 10 00:47:01 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "cinder-10368db8-d87b-4f37-a3c5-16667bb3cff6-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:02 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] 2b7c4d0c-270c-4121-95ac-c2aa29014583 was qcow2, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-10368db8-d87b-4f37-a3c5-16667bb3cff6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:02 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:47:02 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "cinder-quobyte-10368db8-d87b-4f37-a3c5-16667bb3cff6" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-quobyte-10368db8-d87b-4f37-a3c5-16667bb3cff6" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:02 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD" returned: 0 in 0.805s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-855109987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d4f544-bf43-4eba-892f-4783534bb81a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:00Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Creating volume 82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:02 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7ea1db-113a-4124-a928-c9ddf90aa8d8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:02 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a 1073741824 Jul 10 00:47:02 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:02 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 Jul 10 00:47:02 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:03 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6" returned: 0 in 0.803s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:03 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6 Jul 10 00:47:03 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:03 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a 1073741824" returned: 0 in 1.129s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:03 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a Jul 10 00:47:03 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:04 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10368db8-d87b-4f37-a3c5-16667bb3cff6" returned: 0 in 0.748s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-quobyte-10368db8-d87b-4f37-a3c5-16667bb3cff6" released by "delete_volume" :: held 1.656s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Created reservations ['425cbfa7-ee5f-47e7-b312-a7f6403d994d', 'd394dc2e-9d14-4b1b-a88e-d0f5091535f0', 'd8f0cf4d-2fd4-4b83-a1f4-0291b2d6334a', '8c348f54-24d9-45dd-baef-1ac02180717a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:04 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:47:04 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:04 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a" returned: 0 in 0.697s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Attempting download of 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 82d4f544-bf43-4eba-892f-4783534bb81a. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b35288-487f-4a48-b5e2-d84477565a47]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_9os2k03w {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:04 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 0 in 2.131s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_kl2u6_1sdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:47:04 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Converted 112.00 MB image at 52.52 MB/s Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:04 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b 1G Jul 10 00:47:04 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:04 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_9os2k03w Jul 10 00:47:04 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:04 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Deleted volume successfully. Jul 10 00:47:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b37f8932-c6b2-4391-944c-ad3210c5b7ad tempest-SnapshotMetadataTestJSON-2070845127 None] Lock "cinder-10368db8-d87b-4f37-a3c5-16667bb3cff6-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:05 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b 1G" returned: 0 in 0.757s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:05 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_9os2k03w" returned: 0 in 0.848s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_9os2k03w {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:05 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb04c6ee-0c5b-49ee-a2bc-2ade43a7ded1]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:05 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_9os2k03w Jul 10 00:47:05 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:05 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:47:05 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:06 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_9os2k03w" returned: 1 in 0.833s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b7c4d0c-270c-4121-95ac-c2aa29014583_9os2k03w' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2521876-7afa-45c5-9316-dfcbfb97216b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:06 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 0 in 0.883s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:06 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD Jul 10 00:47:06 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:06 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:47:06 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:06 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD" returned: 0 in 0.802s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] 2b7c4d0c-270c-4121-95ac-c2aa29014583 was qcow2, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:06 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a Jul 10 00:47:06 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:06 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 1 in 0.787s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Downloaded image 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 04353fd3-99fe-4da0-98e3-bb8a7073b61b successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 for user 0daeccfa9be74df68d58798d982f87ae is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Marking volume 04353fd3-99fe-4da0-98e3-bb8a7073b61b as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Copying metadata from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 to 04353fd3-99fe-4da0-98e3-bb8a7073b61b. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:47:06 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Creating volume glance metadata for volume 04353fd3-99fe-4da0-98e3-bb8a7073b61b backed by image 2b7c4d0c-270c-4121-95ac-c2aa29014583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:47:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102bbaed-0f06-4a5f-9e16-a3c8ccb6dbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd6406c-ee54-46f0-b8da-c21ed021fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:07 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Volume volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b (04353fd3-99fe-4da0-98e3-bb8a7073b61b): created successfully Jul 10 00:47:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd6406c-ee54-46f0-b8da-c21ed021fff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:07 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Flow 'volume_create_manager' (233546aa-7859-4409-9e06-225fa8a75bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-409b3414-25f0-4d23-b3e4-4492054c2890 tempest-TestShelveInstance-429673887 None] Created volume successfully. Jul 10 00:47:09 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a" returned: 0 in 2.332s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b7c4d0c-270c-4121-95ac-c2aa29014583_qs738z11devstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:47:09 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Converted 112.00 MB image at 48.00 MB/s Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:09 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a 1G Jul 10 00:47:09 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Flow 'volume_create_manager' (66941d28-c313-49a6-aa95-ad7ee7a310f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9ed4d8-5b86-4a02-ac02-ea5bc0af6a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9ed4d8-5b86-4a02-ac02-ea5bc0af6a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2137562504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e211e4-e985-416c-9ba6-cb82be8a7df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77deed0412e4dc79bef4cccfe62f836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:10Z,use_quota=True,user_id='fee84fbefe5343fbbdff67ebd98a3387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97fd7c4-cda7-467f-824c-ec70e074081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97fd7c4-cda7-467f-824c-ec70e074081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b1d9f3-de8f-4bd9-84db-8df381a5f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b1d9f3-de8f-4bd9-84db-8df381a5f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e211e4-e985-416c-9ba6-cb82be8a7df7', 'volume_name': 'volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af748a73-0719-49b1-9cd0-039b80733c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af748a73-0719-49b1-9cd0-039b80733c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7b98b6-57b0-4734-8231-c6b4541dcdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:09 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Volume e4e211e4-e985-416c-9ba6-cb82be8a7df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7', 'volume_size': 1} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2137562504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e211e4-e985-416c-9ba6-cb82be8a7df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77deed0412e4dc79bef4cccfe62f836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:10Z,use_quota=True,user_id='fee84fbefe5343fbbdff67ebd98a3387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Creating volume e4e211e4-e985-416c-9ba6-cb82be8a7df7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:09 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:09 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a 1G" returned: 0 in 0.724s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:09 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 1073741824 Jul 10 00:47:09 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[292ebffc-25d4-4d16-8c28-24911dd9ec3f]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:10 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a Jul 10 00:47:10 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:10 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 1073741824" returned: 0 in 0.894s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:10 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a" returned: 0 in 0.856s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:10 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 Jul 10 00:47:10 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:10 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a Jul 10 00:47:10 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:11 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7" returned: 0 in 0.634s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7b98b6-57b0-4734-8231-c6b4541dcdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c598f5-5abb-4f4a-9b6c-29b51bb29f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:11 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Volume volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 (e4e211e4-e985-416c-9ba6-cb82be8a7df7): created successfully Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c598f5-5abb-4f4a-9b6c-29b51bb29f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Flow 'volume_create_manager' (66941d28-c313-49a6-aa95-ad7ee7a310f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5c955a97-9a96-4190-a653-256e93c55303 tempest-VolumesTransfersV357Test-1342525608 None] Created volume successfully. Jul 10 00:47:11 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a" returned: 1 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Downloaded image 2b7c4d0c-270c-4121-95ac-c2aa29014583 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}])) to volume 82d4f544-bf43-4eba-892f-4783534bb81a successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Temporary image 2b7c4d0c-270c-4121-95ac-c2aa29014583 for user c733649efaf74b46ae0440540025669c is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Marking volume 82d4f544-bf43-4eba-892f-4783534bb81a as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Copying metadata from image 2b7c4d0c-270c-4121-95ac-c2aa29014583 to 82d4f544-bf43-4eba-892f-4783534bb81a. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Creating volume glance metadata for volume 82d4f544-bf43-4eba-892f-4783534bb81a backed by image 2b7c4d0c-270c-4121-95ac-c2aa29014583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8715f4be-d467-4424-befb-56375c309dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d4f544-bf43-4eba-892f-4783534bb81a', 'volume_size': 1, 'image_id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b7c4d0c-270c-4121-95ac-c2aa29014583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12f16b01786648fbb0f5afbb76a3fa37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b7c4d0c-270c-4121-95ac-c2aa29014583', 'created_at': datetime.datetime(2026, 7, 9, 22, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b7c4d0c-270c-4121-95ac-c2aa29014583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19605204-52c4-4241-a4fb-418229456b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:11 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Volume volume-82d4f544-bf43-4eba-892f-4783534bb81a (82d4f544-bf43-4eba-892f-4783534bb81a): created successfully Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19605204-52c4-4241-a4fb-418229456b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (c5f17567-8c63-48ec-bc5d-cb1c0e14efe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-04a01026-f4e0-4cd2-bde6-e5c3f946da16 tempest-VolumesGetTest-557915747 None] Created volume successfully. Jul 10 00:47:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1d217b90-a61f-49e7-bbab-a66853abf561 tempest-VolumesTransfersV357Test-1120539044 None] Transfer volume completed successfully. Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (c8495531-ca42-4de2-a88f-3c9e87b1cb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beda8ef3-d00c-4abe-bddf-b8a7049125dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beda8ef3-d00c-4abe-bddf-b8a7049125dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1551612845',display_name='tempest-VolumesGetTest-Volume-962510896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3893cdba-2472-4724-ae0d-71d13e31a20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:13Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1aa1a66-e172-4b95-aa6d-95d54dc0342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1aa1a66-e172-4b95-aa6d-95d54dc0342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4668b192-ee63-4eac-ae69-926642f35682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4668b192-ee63-4eac-ae69-926642f35682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3893cdba-2472-4724-ae0d-71d13e31a20b', 'volume_name': 'volume-3893cdba-2472-4724-ae0d-71d13e31a20b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c1f774-15f3-4f90-8fc2-ffa1e88cff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c1f774-15f3-4f90-8fc2-ffa1e88cff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec83d47-5c83-4571-ba3b-9bee65f4b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Volume 3893cdba-2472-4724-ae0d-71d13e31a20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3893cdba-2472-4724-ae0d-71d13e31a20b', 'volume_size': 1} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1551612845',display_name='tempest-VolumesGetTest-Volume-962510896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3893cdba-2472-4724-ae0d-71d13e31a20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c34dcb80ba42ac99e4bbb00efea45c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:13Z,use_quota=True,user_id='c733649efaf74b46ae0440540025669c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Creating volume 3893cdba-2472-4724-ae0d-71d13e31a20b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:12 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:47:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:12 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b 1073741824 Jul 10 00:47:12 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Acquiring lock "cinder-e4e211e4-e985-416c-9ba6-cb82be8a7df7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:13 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b 1073741824" returned: 0 in 0.920s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-e4e211e4-e985-416c-9ba6-cb82be8a7df7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Acquiring lock "cinder-quobyte-e4e211e4-e985-416c-9ba6-cb82be8a7df7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-quobyte-e4e211e4-e985-416c-9ba6-cb82be8a7df7" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:13 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b Jul 10 00:47:13 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8649c7cf-16d1-4cac-bf2f-55ef06daddd3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:13 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 Jul 10 00:47:13 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:14 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b" returned: 0 in 0.776s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec83d47-5c83-4571-ba3b-9bee65f4b222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3893cdba-2472-4724-ae0d-71d13e31a20b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c37c7c-af04-48c9-abb9-8c8d2c3f602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:14 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Volume volume-3893cdba-2472-4724-ae0d-71d13e31a20b (3893cdba-2472-4724-ae0d-71d13e31a20b): created successfully Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c37c7c-af04-48c9-abb9-8c8d2c3f602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Flow 'volume_create_manager' (c8495531-ca42-4de2-a88f-3c9e87b1cb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a6ac6862-9532-4b5b-bd3e-583081d17b45 tempest-VolumesGetTest-557915747 None] Created volume successfully. Jul 10 00:47:14 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7" returned: 0 in 0.920s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:14 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7 Jul 10 00:47:14 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-3893cdba-2472-4724-ae0d-71d13e31a20b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Lock "cinder-3893cdba-2472-4724-ae0d-71d13e31a20b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-3893cdba-2472-4724-ae0d-71d13e31a20b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-3893cdba-2472-4724-ae0d-71d13e31a20b" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89b7a4-1bae-4bdc-b0cb-86effb48ad12]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:15 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b Jul 10 00:47:15 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea18331-3e7a-4ff9-adb9-a564e9dfb808]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:15 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e4e211e4-e985-416c-9ba6-cb82be8a7df7" returned: 0 in 0.894s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:15 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:47:15 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-quobyte-e4e211e4-e985-416c-9ba6-cb82be8a7df7" released by "delete_volume" :: held 1.874s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Created reservations ['7489089a-496c-4e69-b54c-f315dbee4639', 'a58f12ae-6601-4a33-92f5-954f471c9e49', 'd9c731e6-e127-4869-875e-23837e4e87da', 'e2193fcc-ce62-4234-88c8-a8314978837e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:15 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:47:15 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:16 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b" returned: 0 in 0.984s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:16 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b Jul 10 00:47:16 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:16 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 0 in 1.078s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:16 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:47:16 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Flow 'volume_create_manager' (314b71dd-76d9-414b-a572-04530ab2eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa6a733-3217-47d6-8278-f914a0e9f375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa6a733-3217-47d6-8278-f914a0e9f375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1414296581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17bbbb7-1652-4ddd-bf0a-3ffd02e89349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77deed0412e4dc79bef4cccfe62f836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:17Z,use_quota=True,user_id='fee84fbefe5343fbbdff67ebd98a3387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3fdf7a-3f26-4f61-b693-1269f4b87f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3fdf7a-3f26-4f61-b693-1269f4b87f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e038c689-8f76-4c80-9b1c-11cfc37be975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e038c689-8f76-4c80-9b1c-11cfc37be975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17bbbb7-1652-4ddd-bf0a-3ffd02e89349', 'volume_name': 'volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0d9e0d-c5c2-4a3b-93d6-04acd81c1f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0d9e0d-c5c2-4a3b-93d6-04acd81c1f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8ced29-1bae-4510-a755-9e2b298b9363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:16 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Volume b17bbbb7-1652-4ddd-bf0a-3ffd02e89349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349', 'volume_size': 1} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:16 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.117s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Deleted volume successfully. Jul 10 00:47:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0ce95cf8-709c-43c3-852e-e9ab5140cdd0 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-e4e211e4-e985-416c-9ba6-cb82be8a7df7-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:17 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3893cdba-2472-4724-ae0d-71d13e31a20b" returned: 0 in 0.887s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-3893cdba-2472-4724-ae0d-71d13e31a20b" released by "delete_volume" :: held 1.934s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Created reservations ['3d685615-aa76-4e6d-b094-bb0922898bb0', 'e071bc5e-5f73-4ae7-92c3-66f8b3e68fef', 'c50acf64-e6d0-4301-bd1a-cc54f20120b7', '2aa604da-62ea-4b9f-9eaf-42e4a781cf27'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:17 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:47:17 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:17 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 1 in 0.954s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.079s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1414296581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17bbbb7-1652-4ddd-bf0a-3ffd02e89349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77deed0412e4dc79bef4cccfe62f836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:17Z,use_quota=True,user_id='fee84fbefe5343fbbdff67ebd98a3387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Creating volume b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:17 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:17 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 1073741824 Jul 10 00:47:17 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4be91dae-1d10-4760-8ca6-51ee6853a5bc', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:47:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-d8ab9600-dfe6-4692-b544-8bf416f250bb req-cedf744a-f909-4ffd-9254-7826d6ee83cf tempest-TestShelveInstance-429673887 None] attachment_update completed successfully. Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-82d4f544-bf43-4eba-892f-4783534bb81a-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Lock "cinder-82d4f544-bf43-4eba-892f-4783534bb81a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Acquiring lock "cinder-quobyte-82d4f544-bf43-4eba-892f-4783534bb81a" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-82d4f544-bf43-4eba-892f-4783534bb81a" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:17 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.735s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Deleted volume successfully. Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b1dc1-17b3-4b49-9431-22534024f3e1]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e0ab1263-289c-4522-9b8e-ad4007391acf tempest-VolumesGetTest-557915747 None] Lock "cinder-3893cdba-2472-4724-ae0d-71d13e31a20b-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:18 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a Jul 10 00:47:18 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:18 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 1073741824" returned: 0 in 1.020s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:18 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 Jul 10 00:47:18 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:18 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a" returned: 0 in 0.848s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:18 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a Jul 10 00:47:18 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:19 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349" returned: 0 in 0.687s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8ced29-1bae-4510-a755-9e2b298b9363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82226bc2-0ddc-4a55-885d-4127920c09b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Volume volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 (b17bbbb7-1652-4ddd-bf0a-3ffd02e89349): created successfully Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82226bc2-0ddc-4a55-885d-4127920c09b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Flow 'volume_create_manager' (314b71dd-76d9-414b-a572-04530ab2eafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-db98e28f-78f8-48f8-b958-6a34e0b7d3b6 tempest-VolumesTransfersV357Test-1342525608 None] Created volume successfully. Jul 10 00:47:19 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a" returned: 1 in 0.788s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:47:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:19 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a Jul 10 00:47:19 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Acquiring lock "cinder-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:20 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-82d4f544-bf43-4eba-892f-4783534bb81a" returned: 0 in 0.672s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Lock "cinder-quobyte-82d4f544-bf43-4eba-892f-4783534bb81a" released by "delete_volume" :: held 2.397s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Acquiring lock "cinder-quobyte-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-quobyte-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38e715e-5998-41e1-ad2c-357baebe7f0e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Created reservations ['3ee47396-b041-42f0-9746-d982e310bbcd', '05a73da7-15e5-4265-b206-59334f7c7e92', 'c6e37bc7-4687-4775-b98c-a266a7fa030c', '2a4eb89c-1a75-4dfc-98e7-86dbc3fde84c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:20 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 Jul 10 00:47:20 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:20 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:47:20 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:21 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.841s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:21 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Deleted volume successfully. Jul 10 00:47:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdccc0f7-4cca-4455-a36e-9fb48e34a972 tempest-VolumesGetTest-557915747 None] Lock "cinder-82d4f544-bf43-4eba-892f-4783534bb81a-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:21 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349" returned: 0 in 1.082s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:21 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349 Jul 10 00:47:21 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:22 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349" returned: 0 in 0.908s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-quobyte-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349" released by "delete_volume" :: held 2.036s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Created reservations ['093fd5b6-1500-437e-9e63-249ec97ffac6', 'dd7cebf8-4612-4cc9-a046-4d13a93f78a7', 'd75eaaf1-54b0-4950-9b51-a75054d9638d', '298f2745-dcc5-4785-adc9-ea97b4148442'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:22 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:47:22 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:23 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.802s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:23 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Deleted volume successfully. Jul 10 00:47:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fa17be93-d160-4a3a-953e-d82cfc585907 tempest-VolumesTransfersV357Test-79637946 None] Lock "cinder-b17bbbb7-1652-4ddd-bf0a-3ffd02e89349-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:32 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=92,cinder:SELECT=87,cinder:INSERT=35,cinder:DELETE=6 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:47:33 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=109,cinder:SELECT=84,cinder:DELETE=11,cinder:INSERT=36 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Flow 'volume_create_manager' (4bcbb234-2c26-4852-b25c-3df439371e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef85c00-74b9-4144-8ce5-6d6e01721561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef85c00-74b9-4144-8ce5-6d6e01721561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877485681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cec55b4-d940-41b2-a4e8-f9eb840c0a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ab99ee1bf4414bd27e9cf73796718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:47Z,use_quota=True,user_id='d4c3aaaa704f44e1bee56b92f4ee81ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3c6858-0250-40a5-9031-93cf84a8c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3c6858-0250-40a5-9031-93cf84a8c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0086d3a9-4d3c-4568-a0a1-8bfaea143f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0086d3a9-4d3c-4568-a0a1-8bfaea143f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cec55b4-d940-41b2-a4e8-f9eb840c0a91', 'volume_name': 'volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c092485-881b-4e5e-a3e9-858d55a2e559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c092485-881b-4e5e-a3e9-858d55a2e559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133e7b69-ed46-491d-992c-822b93afccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:47 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Volume 1cec55b4-d940-41b2-a4e8-f9eb840c0a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91', 'volume_size': 1} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877485681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cec55b4-d940-41b2-a4e8-f9eb840c0a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ab99ee1bf4414bd27e9cf73796718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:47Z,use_quota=True,user_id='d4c3aaaa704f44e1bee56b92f4ee81ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Creating volume 1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:47 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:47:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:47 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 1073741824 Jul 10 00:47:47 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:48 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 1073741824" returned: 0 in 1.007s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:48 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:47:48 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:49 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.731s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:49 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133e7b69-ed46-491d-992c-822b93afccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bca32eb-9042-4c68-af80-9bb6ab21570a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:49 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Volume volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 (1cec55b4-d940-41b2-a4e8-f9eb840c0a91): created successfully Jul 10 00:47:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bca32eb-9042-4c68-af80-9bb6ab21570a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Flow 'volume_create_manager' (4bcbb234-2c26-4852-b25c-3df439371e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:49 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-dfe91dd4-b063-46b2-90a4-14505f779c2b tempest-VolumesActionsTest-325956435 None] Created volume successfully. Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Flow 'volume_create_manager' (11de1a39-e500-4f84-8594-3c0a3ad75cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8485849d-06bf-4f30-bcd0-78bf201daacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8485849d-06bf-4f30-bcd0-78bf201daacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1992009558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d2f4d3-ef69-49dd-8a23-480b12339013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0b00101cd247239f42d412cabd6e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:53Z,use_quota=True,user_id='ab550bd758a646139b59581eb5b51449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07d74e14-a6b2-4aa9-8b68-56ac59ccd969),volume_type_id=07d74e14-a6b2-4aa9-8b68-56ac59ccd969)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88783995-81ad-41be-b4b1-6514abc1dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88783995-81ad-41be-b4b1-6514abc1dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baccc6b7-8354-43b1-8f26-31291382a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baccc6b7-8354-43b1-8f26-31291382a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d2f4d3-ef69-49dd-8a23-480b12339013', 'volume_name': 'volume-15d2f4d3-ef69-49dd-8a23-480b12339013', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3e5eb6-fea1-4286-803c-5ba6942ae3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3e5eb6-fea1-4286-803c-5ba6942ae3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003d8fe3-0019-40e1-afab-3300ccc8a18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Volume 15d2f4d3-ef69-49dd-8a23-480b12339013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d2f4d3-ef69-49dd-8a23-480b12339013', 'volume_size': 1} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1992009558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d2f4d3-ef69-49dd-8a23-480b12339013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0b00101cd247239f42d412cabd6e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:53Z,use_quota=True,user_id='ab550bd758a646139b59581eb5b51449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07d74e14-a6b2-4aa9-8b68-56ac59ccd969),volume_type_id=07d74e14-a6b2-4aa9-8b68-56ac59ccd969)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Creating volume 15d2f4d3-ef69-49dd-8a23-480b12339013 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:53 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:53 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 1073741824 Jul 10 00:47:53 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:53 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:47:53 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Flow 'volume_create_manager' (834da062-10b2-4519-9d1c-4f16fe377a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4505ce9d-ff3c-46d2-aed5-7738f1a8d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4505ce9d-ff3c-46d2-aed5-7738f1a8d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1835200622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d1127e-ace9-4282-bb74-6e3892e2f8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0b00101cd247239f42d412cabd6e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:54Z,use_quota=True,user_id='ab550bd758a646139b59581eb5b51449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(340f5999-70b5-49d6-aa31-65482b33d2b2),volume_type_id=340f5999-70b5-49d6-aa31-65482b33d2b2)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc10656-347b-4651-92bd-6528b4a2d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc10656-347b-4651-92bd-6528b4a2d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43eee8e3-81a4-49c5-9ac3-47f59b365c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43eee8e3-81a4-49c5-9ac3-47f59b365c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d1127e-ace9-4282-bb74-6e3892e2f8ce', 'volume_name': 'volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ea678d-2176-474c-8432-a7fce5ed47d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ea678d-2176-474c-8432-a7fce5ed47d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3222719-ae34-42d6-83ed-f2c7b7c0c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Volume b6d1127e-ace9-4282-bb74-6e3892e2f8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce', 'volume_size': 1} Jul 10 00:47:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:54 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 1073741824" returned: 0 in 1.225s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Flow 'volume_create_manager' (d2165007-64ac-4c22-afcb-3f7e19670082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09267403-ad91-4c4d-afc6-b7d412be74ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:54 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.991s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:54 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 Jul 10 00:47:54 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09267403-ad91-4c4d-afc6-b7d412be74ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-916547977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb16fe5e-506d-48e9-aff9-7bedde2aebbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0b00101cd247239f42d412cabd6e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:54Z,use_quota=True,user_id='ab550bd758a646139b59581eb5b51449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d251e88c-6493-4855-b9f9-9d9e23acaf08),volume_type_id=d251e88c-6493-4855-b9f9-9d9e23acaf08)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754ff0a4-218f-4be6-8d15-ddb5bd63ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754ff0a4-218f-4be6-8d15-ddb5bd63ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6fc4f8-53b3-4dee-b361-370564c3203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6fc4f8-53b3-4dee-b361-370564c3203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb16fe5e-506d-48e9-aff9-7bedde2aebbe', 'volume_name': 'volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe', 'volume_size': 1, 'image_id': 'df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--139770593', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb0b00101cd247239f42d412cabd6e0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'created_at': datetime.datetime(2026, 7, 9, 22, 47, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 47, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866/file', 'properties': {}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc4fbc7-2c39-487a-872a-c3b82d08ad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc4fbc7-2c39-487a-872a-c3b82d08ad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a707ad35-65fe-40b5-8e34-0b6afca36bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Volume fb16fe5e-506d-48e9-aff9-7bedde2aebbe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe', 'volume_size': 1, 'image_id': 'df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--139770593', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb0b00101cd247239f42d412cabd6e0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'created_at': datetime.datetime(2026, 7, 9, 22, 47, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 47, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866/file', 'properties': {}}, 'image_service': } Jul 10 00:47:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Trying to clone fb16fe5e-506d-48e9-aff9-7bedde2aebbe from image df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:47:55 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013" returned: 0 in 0.766s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.561s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1835200622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d1127e-ace9-4282-bb74-6e3892e2f8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0b00101cd247239f42d412cabd6e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:54Z,use_quota=True,user_id='ab550bd758a646139b59581eb5b51449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(340f5999-70b5-49d6-aa31-65482b33d2b2),volume_type_id=340f5999-70b5-49d6-aa31-65482b33d2b2)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Creating volume b6d1127e-ace9-4282-bb74-6e3892e2f8ce {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:55 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003d8fe3-0019-40e1-afab-3300ccc8a18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d2f4d3-ef69-49dd-8a23-480b12339013', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:55 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce 1073741824 Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3028972c-0382-4f1e-ba22-7d83514edb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:55 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Volume volume-15d2f4d3-ef69-49dd-8a23-480b12339013 (15d2f4d3-ef69-49dd-8a23-480b12339013): created successfully Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3028972c-0382-4f1e-ba22-7d83514edb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Flow 'volume_create_manager' (11de1a39-e500-4f84-8594-3c0a3ad75cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-820b4743-04d6-42c5-999b-670f37d75e34 tempest-TestInstancesWithCinderVolumes-107754862 None] Created volume successfully. Jul 10 00:47:56 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce 1073741824" returned: 0 in 1.244s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:56 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce Jul 10 00:47:56 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:57 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce" returned: 0 in 1.171s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:57 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] <== create_volume: return (2472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.475s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3222719-ae34-42d6-83ed-f2c7b7c0c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a272695f-e559-4117-8421-063a30701233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:57 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Volume volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce (b6d1127e-ace9-4282-bb74-6e3892e2f8ce): created successfully Jul 10 00:47:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a272695f-e559-4117-8421-063a30701233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Flow 'volume_create_manager' (834da062-10b2-4519-9d1c-4f16fe377a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cca2d02d-ac29-4541-b03a-706725c9f551 tempest-TestInstancesWithCinderVolumes-107754862 None] Created volume successfully. Jul 10 00:47:59 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD, size 20.69 MB, duration 4.14 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:47:59 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Image download 20.69 MB at 4.99 MB/s Jul 10 00:47:59 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02834bd-18e1-4890-b0d0-1c017abb59e7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:59 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD Jul 10 00:47:59 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:59 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD" returned: 0 in 0.892s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:59 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Temporary image df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 is fetched for user ab550bd758a646139b59581eb5b51449. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb684b-1cc1-4b33-9e06-56aa9030e527]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:00 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD Jul 10 00:48:00 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-d41cc2cd-7362-4701-a654-be99a22a6d77 req-18eb7940-54d7-4e3c-8556-7522490aae2e tempest-TestShelveInstance-429673887 None] Terminate volume connection completed successfully. Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-d41cc2cd-7362-4701-a654-be99a22a6d77 req-18eb7940-54d7-4e3c-8556-7522490aae2e tempest-TestShelveInstance-429673887 None] Deleting attachment 4be91dae-1d10-4760-8ca6-51ee6853a5bc. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:48:00 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-916547977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb16fe5e-506d-48e9-aff9-7bedde2aebbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0b00101cd247239f42d412cabd6e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:54Z,use_quota=True,user_id='ab550bd758a646139b59581eb5b51449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d251e88c-6493-4855-b9f9-9d9e23acaf08),volume_type_id=d251e88c-6493-4855-b9f9-9d9e23acaf08)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Creating volume fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:00 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:48:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:00 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe 1073741824 Jul 10 00:48:00 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:01 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe 1073741824" returned: 0 in 1.109s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:01 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:48:01 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:02 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 0 in 0.780s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:02 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Attempting download of df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 ((None, [{'url': 'file:///opt/stack/data/glance/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'metadata': {}}])) to volume fb16fe5e-506d-48e9-aff9-7bedde2aebbe. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:48:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[219c7290-adf0-48e7-a7a5-672fe96cc2a5]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_0pi44gjz {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:02 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_0pi44gjz Jul 10 00:48:02 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:03 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_0pi44gjz" returned: 0 in 0.888s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_0pi44gjz {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:03 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_0pi44gjz Jul 10 00:48:03 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:04 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_0pi44gjz" returned: 1 in 0.841s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_0pi44gjz' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:48:04 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ddb8bc-e694-44b8-a105-99bb07c6eefd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:04 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD Jul 10 00:48:04 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:05 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:05 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 was qcow2, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:48:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:05 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:48:05 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-45f3383e-5bf6-4a70-a5ab-3f4591b429cb tempest-VolumesActionsTest-325956435 None] Acquiring lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" by "attach_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-45f3383e-5bf6-4a70-a5ab-3f4591b429cb tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" acquired by "attach_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-45f3383e-5bf6-4a70-a5ab-3f4591b429cb tempest-VolumesActionsTest-325956435 None] Attaching volume 1cec55b4-d940-41b2-a4e8-f9eb840c0a91 to instance 7987fd0f-eedd-4fee-9d22-57e11c38b5fd at mountpoint /dev/vdb on host None. Jul 10 00:48:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-45f3383e-5bf6-4a70-a5ab-3f4591b429cb tempest-VolumesActionsTest-325956435 None] Attach volume completed successfully. Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-45f3383e-5bf6-4a70-a5ab-3f4591b429cb tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" released by "attach_volume" :: held 0.145s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[904656bb-ffde-42ce-9505-c5f204a2f644]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:06 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:48:06 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-29d637a4-3ba5-4fce-a406-25dd3ad5c504 tempest-VolumesActionsTest-325956435 None] Acquiring lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-detach_volume" by "detach_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-29d637a4-3ba5-4fce-a406-25dd3ad5c504 tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-29d637a4-3ba5-4fce-a406-25dd3ad5c504 tempest-VolumesActionsTest-325956435 None] Detaching volume 1cec55b4-d940-41b2-a4e8-f9eb840c0a91 from instance 7987fd0f-eedd-4fee-9d22-57e11c38b5fd. Jul 10 00:48:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-29d637a4-3ba5-4fce-a406-25dd3ad5c504 tempest-VolumesActionsTest-325956435 None] Detach volume completed successfully. Jul 10 00:48:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-29d637a4-3ba5-4fce-a406-25dd3ad5c504 tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:07 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 0 in 0.807s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:07 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:48:07 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:07 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 0 in 2.454s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:07 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df6a0e3e-5fdb-4647-8ab6-bbf87cde2866_hvegg66kdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:48:07 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Converted 112.00 MB image at 45.61 MB/s Jul 10 00:48:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:07 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe 1G Jul 10 00:48:07 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:08 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 1 in 0.977s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:48:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.842s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16053be3-f709-49bf-a956-d2abf22ab6e2', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:48:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-b6ffb7b6-11cd-4062-ac01-e43364c98088 req-5042b696-e0f8-4735-b585-7a6c2e1f898f tempest-TestShelveInstance-429673887 None] attachment_update completed successfully. Jul 10 00:48:08 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe 1G" returned: 0 in 0.751s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0648b3-cabd-4357-8b4b-9400e4aa9070]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:08 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:48:08 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:09 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 0 in 0.860s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:09 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:48:09 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:10 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 1 in 0.840s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Downloaded image df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 ((None, [{'url': 'file:///opt/stack/data/glance/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'metadata': {}}])) to volume fb16fe5e-506d-48e9-aff9-7bedde2aebbe successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Temporary image df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 for user ab550bd758a646139b59581eb5b51449 is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Marking volume fb16fe5e-506d-48e9-aff9-7bedde2aebbe as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Copying metadata from image df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 to fb16fe5e-506d-48e9-aff9-7bedde2aebbe. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Creating volume glance metadata for volume fb16fe5e-506d-48e9-aff9-7bedde2aebbe backed by image df6a0e3e-5fdb-4647-8ab6-bbf87cde2866 with: {'image_id': 'df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'image_name': 'tempest-scenario-img--139770593', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a707ad35-65fe-40b5-8e34-0b6afca36bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe', 'volume_size': 1, 'image_id': 'df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--139770593', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb0b00101cd247239f42d412cabd6e0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df6a0e3e-5fdb-4647-8ab6-bbf87cde2866', 'created_at': datetime.datetime(2026, 7, 9, 22, 47, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 47, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df6a0e3e-5fdb-4647-8ab6-bbf87cde2866/file', 'properties': {}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64407a2-0c2d-4cef-a709-6a64c513ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:10 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Volume volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe (fb16fe5e-506d-48e9-aff9-7bedde2aebbe): created successfully Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64407a2-0c2d-4cef-a709-6a64c513ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Flow 'volume_create_manager' (d2165007-64ac-4c22-afcb-3f7e19670082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1ea1cfa6-8c0f-4a5d-befc-cb4d791e244c tempest-TestInstancesWithCinderVolumes-107754862 None] Created volume successfully. Jul 10 00:48:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc163eb-490f-4ceb-ac50-be2e7f3aac06]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:18 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:48:18 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:19 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 0 in 0.841s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:19 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:48:19 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:20 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 1 in 0.946s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:48:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.839s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e7ebd52-9466-4d91-afd3-025b1a80c464', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:48:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-ea757311-c2bd-4413-8490-1c782a9d73be req-6331df89-25de-4d3f-95f4-38f41416d963 tempest-TestInstancesWithCinderVolumes-107754862 None] attachment_update completed successfully. Jul 10 00:48:30 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=29,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:48:30 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=12,cinder:DELETE=3 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:48:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8459aa4d-cc7e-46bc-ba06-2ddee6020a2a tempest-VolumesActionsTest-325956435 None] Acquiring lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" by "attach_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8459aa4d-cc7e-46bc-ba06-2ddee6020a2a tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" acquired by "attach_volume" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8459aa4d-cc7e-46bc-ba06-2ddee6020a2a tempest-VolumesActionsTest-325956435 None] Attaching volume 1cec55b4-d940-41b2-a4e8-f9eb840c0a91 to instance 29ef22f9-e3da-4b9e-9daa-8843643ec462 at mountpoint /dev/vdb on host None. Jul 10 00:48:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8459aa4d-cc7e-46bc-ba06-2ddee6020a2a tempest-VolumesActionsTest-325956435 None] Attach volume completed successfully. Jul 10 00:48:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8459aa4d-cc7e-46bc-ba06-2ddee6020a2a tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" released by "attach_volume" :: held 0.226s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e526311b-b50d-4ca5-84c8-12d091ea242d tempest-VolumesActionsTest-325956435 None] Acquiring lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-detach_volume" by "detach_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e526311b-b50d-4ca5-84c8-12d091ea242d tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e526311b-b50d-4ca5-84c8-12d091ea242d tempest-VolumesActionsTest-325956435 None] Detaching volume 1cec55b4-d940-41b2-a4e8-f9eb840c0a91 from instance 29ef22f9-e3da-4b9e-9daa-8843643ec462. Jul 10 00:48:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e526311b-b50d-4ca5-84c8-12d091ea242d tempest-VolumesActionsTest-325956435 None] Detach volume completed successfully. Jul 10 00:48:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e526311b-b50d-4ca5-84c8-12d091ea242d tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-detach_volume" released by "detach_volume" :: held 0.192s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:43 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea762fe-9e2f-46c2-9f12-54c60b1c5acd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:43 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:48:43 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:44 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.944s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:44 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:48:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb099d6-9ec7-4da5-9e60-48fbc0597918]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:44 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:48:44 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:45 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.889s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.78450bd6-aebe-4062-8bc5-6784392b9141uycyieyt.img {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:45 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.78450bd6-aebe-4062-8bc5-6784392b9141uycyieyt.img Jul 10 00:48:45 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:49 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.78450bd6-aebe-4062-8bc5-6784392b9141uycyieyt.img" returned: 0 in 4.175s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:49 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c12c217-18bc-4b23-bf84-11c6bcad2170]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:49 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:48:49 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:50 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.895s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:50 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.78450bd6-aebe-4062-8bc5-6784392b9141uycyieyt.img {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:48:50 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Converted 1024.00 MB image at 245.23 MB/s Jul 10 00:48:50 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] 78450bd6-aebe-4062-8bc5-6784392b9141 was raw, no need to convert to raw {{(pid=87452) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 00:48:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:48:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:53 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:48:53 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:54 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.826s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:48:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:48:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:49:00 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:49:00 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:49:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ad8cfec7-cfc7-45da-81ef-ac712d198629 req-c1930be9-95b0-41b1-b49f-9b60857c3766 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-ed896c3c-e09d-400f-8a02-aca4e82079c6 tempest-TestShelveInstance-429673887 None] Terminate volume connection completed successfully. Jul 10 00:49:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-ed896c3c-e09d-400f-8a02-aca4e82079c6 tempest-TestShelveInstance-429673887 None] Deleting attachment 16053be3-f709-49bf-a956-d2abf22ab6e2. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:49:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Acquiring lock "cinder-04353fd3-99fe-4da0-98e3-bb8a7073b61b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Lock "cinder-04353fd3-99fe-4da0-98e3-bb8a7073b61b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Acquiring lock "cinder-quobyte-04353fd3-99fe-4da0-98e3-bb8a7073b61b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Lock "cinder-quobyte-04353fd3-99fe-4da0-98e3-bb8a7073b61b" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b35e7-8881-47f2-9fb5-1e6753bd9ba5]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:03 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:49:03 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:04 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 0 in 0.840s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:04 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:49:04 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:05 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 1 in 0.836s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:05 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b Jul 10 00:49:05 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:05 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04353fd3-99fe-4da0-98e3-bb8a7073b61b" returned: 0 in 0.673s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Lock "cinder-quobyte-04353fd3-99fe-4da0-98e3-bb8a7073b61b" released by "delete_volume" :: held 2.427s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:05 devstack cinder-volume[87452]: DEBUG cinder.quota [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Created reservations ['cb109782-6a53-46bf-aed2-b73521607a23', '96b7af6e-dd40-4b30-9d06-611679bc9574', '2573aeda-ba6e-44d9-9d75-28b175acd62b', '63149136-1255-4da9-bc09-7ae4f4150d3f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:06 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:06 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:06 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.827s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG cinder.manager [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Deleted volume successfully. Jul 10 00:49:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [req-f94d8f86-7385-40b1-ada4-8e2c5a7e5130 req-8603d3d5-d53a-4c4d-acf1-7794d6399017 tempest-TestShelveInstance-429673887 None] Lock "cinder-04353fd3-99fe-4da0-98e3-bb8a7073b61b-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.760s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Uploaded volume to glance image-id: 78450bd6-aebe-4062-8bc5-6784392b9141. {{(pid=87452) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 00:49:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ad8cfec7-cfc7-45da-81ef-ac712d198629 req-c1930be9-95b0-41b1-b49f-9b60857c3766 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.943s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[18206806-2e1e-4539-ae68-c11e0dfc2641]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ad8cfec7-cfc7-45da-81ef-ac712d198629 req-c1930be9-95b0-41b1-b49f-9b60857c3766 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-abac210a-f721-47a7-a8f3-ec1b8391bd44 tempest-VolumesActionsTest-325956435 None] Copy volume to image completed successfully. Jul 10 00:49:11 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 Jul 10 00:49:11 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:11 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-ad8cfec7-cfc7-45da-81ef-ac712d198629 req-c1930be9-95b0-41b1-b49f-9b60857c3766 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013" returned: 0 in 0.798s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-ad8cfec7-cfc7-45da-81ef-ac712d198629 req-c1930be9-95b0-41b1-b49f-9b60857c3766 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-ad8cfec7-cfc7-45da-81ef-ac712d198629 req-c1930be9-95b0-41b1-b49f-9b60857c3766 tempest-TestInstancesWithCinderVolumes-107754862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-15d2f4d3-ef69-49dd-8a23-480b12339013', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '141b4218-c4ee-472c-a69e-4c1d142597cb', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:49:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-ad8cfec7-cfc7-45da-81ef-ac712d198629 req-c1930be9-95b0-41b1-b49f-9b60857c3766 tempest-TestInstancesWithCinderVolumes-107754862 None] attachment_update completed successfully. Jul 10 00:49:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b935842f-7631-4a4d-bf8f-8477aec53f20]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:12 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:49:12 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:13 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.902s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eab86b-8e70-44e2-a2bc-e42f0b24d645]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:13 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:49:13 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:14 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.801s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:14 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img Jul 10 00:49:14 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:19 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img" returned: 0 in 5.348s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:19 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[107a62c3-184d-4e52-96f8-9f2610938f09]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:19 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:49:19 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:20 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 1.014s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:20 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:49:20 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Converted 1024.00 MB image at 191.45 MB/s Jul 10 00:49:20 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] ef5267d1-db30-4c48-8331-4873af85890a was raw, converting to qcow2 {{(pid=87452) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 00:49:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4654923d-07e2-4ffe-ac3b-81152ce3136a]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:20 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img Jul 10 00:49:20 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-90fb72af-352a-4783-a90f-889678f6b3a9 req-a99dcc97-e6c9-4244-bf7a-fa18459b5b12 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:21 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img" returned: 0 in 0.713s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:21 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img Jul 10 00:49:21 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:22 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img" returned: 1 in 0.828s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img /opt/stack/data/cinder/conversion/vol_upload_516_1y56 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:22 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img /opt/stack/data/cinder/conversion/vol_upload_516_1y56 Jul 10 00:49:22 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:22 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img /opt/stack/data/cinder/conversion/vol_upload_516_1y56" returned: 0 in 0.714s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:22 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Image conversion details: src /opt/stack/data/cinder/conversion/1cec55b4-d940-41b2-a4e8-f9eb840c0a91.temp_image.ef5267d1-db30-4c48-8331-4873af85890an62par6t.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_516_1y56 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:49:22 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 00:49:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef79966-74aa-4604-8aa8-9ab70ae4e568]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_516_1y56 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:22 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_516_1y56 Jul 10 00:49:22 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:23 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_516_1y56" returned: 0 in 0.833s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Flow 'volume_create_manager' (c1f6ed6b-2ac3-4425-9243-90a38955b1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8250597-6b77-4e9d-a2a1-10acd99fe7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8250597-6b77-4e9d-a2a1-10acd99fe7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c0b902-c135-4098-ac0b-be9d7a88a46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ce659ded864433982b19b74e77637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:25Z,use_quota=True,user_id='50edae28b2594607bf3122d5af84512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d2d1f0b-48e8-4551-8d6a-a47fda58352a),volume_type_id=0d2d1f0b-48e8-4551-8d6a-a47fda58352a)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e6b04-c922-4c9c-8374-4fe25640c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e6b04-c922-4c9c-8374-4fe25640c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d52f5c-099c-4a6a-b165-59f6a50c2828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d52f5c-099c-4a6a-b165-59f6a50c2828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4c0b902-c135-4098-ac0b-be9d7a88a46a', 'volume_name': 'volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a', 'volume_size': 1, 'image_id': 'a4431ac3-6e79-484c-8372-edc75ae22f91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4431ac3-6e79-484c-8372-edc75ae22f91', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e062213bc7ce2a7eeb6907d927a76cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6ce659ded864433982b19b74e77637f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2579b2c3d8804f2c7df542b3b47ecdd71d37a58dedabfe79aec143a891bb72876e6e6c5ed2c3dab30c44bfc609bb71eb87f2d30b0cd795f0d2d568555d4dd520', 'id': 'a4431ac3-6e79-484c-8372-edc75ae22f91', 'created_at': datetime.datetime(2026, 7, 9, 22, 49, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 49, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4431ac3-6e79-484c-8372-edc75ae22f91/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2ca819-c710-4acf-acc6-1cd0c7adfa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2ca819-c710-4acf-acc6-1cd0c7adfa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8d4f82-085f-418b-9f5b-f05663347b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:24 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Volume d4c0b902-c135-4098-ac0b-be9d7a88a46a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a', 'volume_size': 1, 'image_id': 'a4431ac3-6e79-484c-8372-edc75ae22f91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4431ac3-6e79-484c-8372-edc75ae22f91', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e062213bc7ce2a7eeb6907d927a76cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6ce659ded864433982b19b74e77637f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2579b2c3d8804f2c7df542b3b47ecdd71d37a58dedabfe79aec143a891bb72876e6e6c5ed2c3dab30c44bfc609bb71eb87f2d30b0cd795f0d2d568555d4dd520', 'id': 'a4431ac3-6e79-484c-8372-edc75ae22f91', 'created_at': datetime.datetime(2026, 7, 9, 22, 49, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 49, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4431ac3-6e79-484c-8372-edc75ae22f91/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 00:49:24 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Trying to clone d4c0b902-c135-4098-ac0b-be9d7a88a46a from image a4431ac3-6e79-484c-8372-edc75ae22f91 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4431ac3-6e79-484c-8372-edc75ae22f91', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:49:25 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3cf1f-1bad-4d1b-b6b6-73790b00bc3c]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.855s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Uploaded volume to glance image-id: ef5267d1-db30-4c48-8331-4873af85890a. {{(pid=87452) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-90fb72af-352a-4783-a90f-889678f6b3a9 req-a99dcc97-e6c9-4244-bf7a-fa18459b5b12 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.200s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2950498e-1c76-400f-9d37-6c63f63f5e19]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-90fb72af-352a-4783-a90f-889678f6b3a9 req-a99dcc97-e6c9-4244-bf7a-fa18459b5b12 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c9bd91b4-e9e1-40f3-80e2-5aa433965198 tempest-VolumesActionsTest-325956435 None] Copy volume to image completed successfully. Jul 10 00:49:25 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD Jul 10 00:49:25 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:25 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce Jul 10 00:49:25 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:26 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-90fb72af-352a-4783-a90f-889678f6b3a9 req-a99dcc97-e6c9-4244-bf7a-fa18459b5b12 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce" returned: 0 in 0.799s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-90fb72af-352a-4783-a90f-889678f6b3a9 req-a99dcc97-e6c9-4244-bf7a-fa18459b5b12 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.825s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:26 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-90fb72af-352a-4783-a90f-889678f6b3a9 req-a99dcc97-e6c9-4244-bf7a-fa18459b5b12 tempest-TestInstancesWithCinderVolumes-107754862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43d243f9-9363-4738-941f-551418076f46', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:49:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-90fb72af-352a-4783-a90f-889678f6b3a9 req-a99dcc97-e6c9-4244-bf7a-fa18459b5b12 tempest-TestInstancesWithCinderVolumes-107754862 None] attachment_update completed successfully. Jul 10 00:49:26 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD Jul 10 00:49:26 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Acquiring lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Acquiring lock "cinder-quobyte-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Lock "cinder-quobyte-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[121b9ec1-fce5-46cc-8fbf-a43b23611e98]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:26 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD" returned: 1 in 0.848s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Temporary image a4431ac3-6e79-484c-8372-edc75ae22f91 is fetched for user 50edae28b2594607bf3122d5af84512c. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f616b5-bd1b-4abb-83c4-a68b4973ebe2]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:26 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:49:26 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:27 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD Jul 10 00:49:27 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:27 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.838s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:27 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91 Jul 10 00:49:27 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:27 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:27 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD Jul 10 00:49:27 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:28 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" returned: 0 in 0.661s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Lock "cinder-quobyte-1cec55b4-d940-41b2-a4e8-f9eb840c0a91" released by "delete_volume" :: held 1.538s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Created reservations ['e056c937-28c0-42bf-8a92-3dec59e7405f', 'c06a6b87-3e4c-464b-bc6f-b9f2ec5806ee', '381709fd-a2c0-4421-9f6e-f2d674d60e4c', '1fa3a588-bb2e-47e7-b719-0b8995b3640a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:28 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:28 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:28 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c0b902-c135-4098-ac0b-be9d7a88a46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ce659ded864433982b19b74e77637f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:25Z,use_quota=True,user_id='50edae28b2594607bf3122d5af84512c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d2d1f0b-48e8-4551-8d6a-a47fda58352a),volume_type_id=0d2d1f0b-48e8-4551-8d6a-a47fda58352a)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Creating volume d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:49:28 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:49:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:28 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a 1073741824 Jul 10 00:49:28 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:29 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.658s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:29 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Deleted volume successfully. Jul 10 00:49:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d98f5a1-8379-4ad7-af36-1daadc9e8844 tempest-VolumesActionsTest-325956435 None] Lock "cinder-1cec55b4-d940-41b2-a4e8-f9eb840c0a91-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:29 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a 1073741824" returned: 0 in 0.919s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:29 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a Jul 10 00:49:29 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:30 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a" returned: 0 in 0.693s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:49:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:30 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Attempting download of a4431ac3-6e79-484c-8372-edc75ae22f91 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4431ac3-6e79-484c-8372-edc75ae22f91', 'metadata': {}}])) to volume d4c0b902-c135-4098-ac0b-be9d7a88a46a. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:49:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f765b9-4cdf-4b5b-82d9-402b7eeeb0d6]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4431ac3-6e79-484c-8372-edc75ae22f91_r66y3138 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:30 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4431ac3-6e79-484c-8372-edc75ae22f91_r66y3138 Jul 10 00:49:30 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:31 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4431ac3-6e79-484c-8372-edc75ae22f91_r66y3138" returned: 0 in 0.987s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4431ac3-6e79-484c-8372-edc75ae22f91_r66y3138 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:31 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4431ac3-6e79-484c-8372-edc75ae22f91_r66y3138 Jul 10 00:49:31 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:32 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4431ac3-6e79-484c-8372-edc75ae22f91_r66y3138" returned: 1 in 0.822s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4431ac3-6e79-484c-8372-edc75ae22f91_r66y3138' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aaf658-7b97-4b88-8bb8-5dd7a4270125]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:32 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD Jul 10 00:49:32 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:33 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:33 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD Jul 10 00:49:33 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:33 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:33 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] a4431ac3-6e79-484c-8372-edc75ae22f91 was raw, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:49:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:33 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a Jul 10 00:49:33 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:34 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a" returned: 0 in 0.829s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:34 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4431ac3-6e79-484c-8372-edc75ae22f91_wri9_5vndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:49:34 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:49:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:34 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a 1G Jul 10 00:49:34 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-9d35c5e1-2048-4cf4-97cd-debdf55312c6 req-063abcfe-5c43-421d-82e1-ae632dc72dde tempest-TestInstancesWithCinderVolumes-107754862 None] Terminate volume connection completed successfully. Jul 10 00:49:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-9d35c5e1-2048-4cf4-97cd-debdf55312c6 req-063abcfe-5c43-421d-82e1-ae632dc72dde tempest-TestInstancesWithCinderVolumes-107754862 None] Deleting attachment 141b4218-c4ee-472c-a69e-4c1d142597cb. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:49:35 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a 1G" returned: 0 in 0.789s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[944aa0be-070b-4e7a-afde-48c4d6ff60ad]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:35 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a Jul 10 00:49:35 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Flow 'volume_create_manager' (b99a427a-a870-4b75-a812-2eb2f122e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bffec8b-fd9f-4f79-933e-51f90111ca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bffec8b-fd9f-4f79-933e-51f90111ca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1184387109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d406173-eb7f-45de-b046-848c1ef0580d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2bb05683534f52bad0e33ee58edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:36Z,use_quota=True,user_id='55e30b48c2d54bc2ac724b6e5f3490fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76894244-9615-430f-9cdb-6fd4222a6c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76894244-9615-430f-9cdb-6fd4222a6c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b936a0f-99e0-405e-9cd0-bda4776eadd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b936a0f-99e0-405e-9cd0-bda4776eadd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d406173-eb7f-45de-b046-848c1ef0580d', 'volume_name': 'volume-1d406173-eb7f-45de-b046-848c1ef0580d', 'volume_size': 2}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cddd1e6-b6a4-4791-bf9e-58b3c2f336fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cddd1e6-b6a4-4791-bf9e-58b3c2f336fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dd0bc7-7bc2-4b74-b72f-b279005c20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:36 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Volume 1d406173-eb7f-45de-b046-848c1ef0580d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d406173-eb7f-45de-b046-848c1ef0580d', 'volume_size': 2} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1184387109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d406173-eb7f-45de-b046-848c1ef0580d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2bb05683534f52bad0e33ee58edeac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:36Z,use_quota=True,user_id='55e30b48c2d54bc2ac724b6e5f3490fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Creating volume 1d406173-eb7f-45de-b046-848c1ef0580d {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:49:36 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d 2147483648 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:36 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d 2147483648 Jul 10 00:49:36 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:36 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a" returned: 0 in 0.779s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:36 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a Jul 10 00:49:36 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:37 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d 2147483648" returned: 0 in 0.934s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:37 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a" returned: 1 in 0.787s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Downloaded image a4431ac3-6e79-484c-8372-edc75ae22f91 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4431ac3-6e79-484c-8372-edc75ae22f91', 'metadata': {}}])) to volume d4c0b902-c135-4098-ac0b-be9d7a88a46a successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Temporary image a4431ac3-6e79-484c-8372-edc75ae22f91 for user 50edae28b2594607bf3122d5af84512c is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Marking volume d4c0b902-c135-4098-ac0b-be9d7a88a46a as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Copying metadata from image a4431ac3-6e79-484c-8372-edc75ae22f91 to d4c0b902-c135-4098-ac0b-be9d7a88a46a. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Creating volume glance metadata for volume d4c0b902-c135-4098-ac0b-be9d7a88a46a backed by image a4431ac3-6e79-484c-8372-edc75ae22f91 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a4431ac3-6e79-484c-8372-edc75ae22f91', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2e062213bc7ce2a7eeb6907d927a76cb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:37 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d Jul 10 00:49:37 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8d4f82-085f-418b-9f5b-f05663347b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a', 'volume_size': 1, 'image_id': 'a4431ac3-6e79-484c-8372-edc75ae22f91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4431ac3-6e79-484c-8372-edc75ae22f91', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e062213bc7ce2a7eeb6907d927a76cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6ce659ded864433982b19b74e77637f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2579b2c3d8804f2c7df542b3b47ecdd71d37a58dedabfe79aec143a891bb72876e6e6c5ed2c3dab30c44bfc609bb71eb87f2d30b0cd795f0d2d568555d4dd520', 'id': 'a4431ac3-6e79-484c-8372-edc75ae22f91', 'created_at': datetime.datetime(2026, 7, 9, 22, 49, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 49, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4431ac3-6e79-484c-8372-edc75ae22f91/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f45c271-6b8c-4eb6-ace7-f946e8265fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:37 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Volume volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a (d4c0b902-c135-4098-ac0b-be9d7a88a46a): created successfully Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f45c271-6b8c-4eb6-ace7-f946e8265fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Flow 'volume_create_manager' (c1f6ed6b-2ac3-4425-9243-90a38955b1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8ea460db-c252-4427-8222-8b70b51b4d01 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Created volume successfully. Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Acquiring lock "cinder-d4c0b902-c135-4098-ac0b-be9d7a88a46a-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "cinder-d4c0b902-c135-4098-ac0b-be9d7a88a46a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "cinder-15d2f4d3-ef69-49dd-8a23-480b12339013-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Acquiring lock "cinder-quobyte-d4c0b902-c135-4098-ac0b-be9d7a88a46a" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-15d2f4d3-ef69-49dd-8a23-480b12339013-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "cinder-quobyte-d4c0b902-c135-4098-ac0b-be9d7a88a46a" acquired by "delete_volume" :: waited 0.037s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "cinder-quobyte-15d2f4d3-ef69-49dd-8a23-480b12339013" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-quobyte-15d2f4d3-ef69-49dd-8a23-480b12339013" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf9130b-c6d1-4857-b6b1-96414db19ee0]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5edb51f-a0dc-4e17-9d46-9a94322ec499]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:37 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a Jul 10 00:49:37 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:37 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 Jul 10 00:49:37 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:37 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d" returned: 0 in 0.693s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dd0bc7-7bc2-4b74-b72f-b279005c20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d406173-eb7f-45de-b046-848c1ef0580d', 'volume_size': 2}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a622f1c9-0e6d-4f42-a239-4c82115fb3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:37 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Volume volume-1d406173-eb7f-45de-b046-848c1ef0580d (1d406173-eb7f-45de-b046-848c1ef0580d): created successfully Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a622f1c9-0e6d-4f42-a239-4c82115fb3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Flow 'volume_create_manager' (b99a427a-a870-4b75-a812-2eb2f122e50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3763a276-1f6f-4d2b-add5-f2ed48b8b285 tempest-VolumesCloneNegativeTest-133956041 None] Created volume successfully. Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Acquiring lock "cinder-1d406173-eb7f-45de-b046-848c1ef0580d-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Lock "cinder-1d406173-eb7f-45de-b046-848c1ef0580d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Acquiring lock "cinder-quobyte-1d406173-eb7f-45de-b046-848c1ef0580d" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Lock "cinder-quobyte-1d406173-eb7f-45de-b046-848c1ef0580d" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84d0cdc-b88a-4b04-a232-67ebc9bf55ac]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:38 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a" returned: 0 in 0.886s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:38 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013" returned: 0 in 0.930s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:38 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d Jul 10 00:49:38 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:38 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013 Jul 10 00:49:38 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:38 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a Jul 10 00:49:38 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:39 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d" returned: 0 in 0.877s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:39 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-15d2f4d3-ef69-49dd-8a23-480b12339013" returned: 0 in 0.769s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:39 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d Jul 10 00:49:39 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-quobyte-15d2f4d3-ef69-49dd-8a23-480b12339013" released by "delete_volume" :: held 1.751s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:39 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a" returned: 1 in 0.882s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:39 devstack cinder-volume[87452]: WARNING cinder.quota [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-620201129-385451221 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-620201129-385451221, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:39 devstack cinder-volume[87452]: WARNING cinder.quota [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-620201129-385451221 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-620201129-385451221, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:39 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a Jul 10 00:49:39 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Created reservations ['5f7f0c26-33b7-45b8-acc1-dd642a956d33', '72ef6881-a896-4736-8c9a-cd27754abdf0', 'a5ba2ece-64ed-460f-aabb-f41a82e391db', '793f90a2-87a9-46a6-947b-e476cf094709'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:39 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:39 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:40 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-1d406173-eb7f-45de-b046-848c1ef0580d" returned: 0 in 0.754s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Lock "cinder-quobyte-1d406173-eb7f-45de-b046-848c1ef0580d" released by "delete_volume" :: held 1.692s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Created reservations ['2d747b06-b96a-4107-ba2b-f1be7a56ba8c', '9428d81e-6db2-4e32-bd7e-a87ee021c25d', 'eaca0bd9-afce-4914-8882-b5fc810a83cb', '256bb369-ddc1-4b11-948f-cc6dfcb93b1d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:40 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d4c0b902-c135-4098-ac0b-be9d7a88a46a" returned: 0 in 0.780s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "cinder-quobyte-d4c0b902-c135-4098-ac0b-be9d7a88a46a" released by "delete_volume" :: held 2.644s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:40 devstack cinder-volume[87452]: WARNING cinder.quota [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:40 devstack cinder-volume[87452]: WARNING cinder.quota [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:40 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.746s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Deleted volume successfully. Jul 10 00:49:40 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:40 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Created reservations ['32c59779-ec37-472b-a3f1-93c9b8d53938', 'dd1eb3dd-1abb-4958-b86b-608732985536', '44a982ab-b52d-49db-886c-22e2bb9b3725', '287e2df0-773b-4f8c-96ef-e2783302b2b4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f261ddbd-69e9-4778-8082-ca010f6935bf tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-15d2f4d3-ef69-49dd-8a23-480b12339013-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:40 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:40 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:41 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.936s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:41 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Deleted volume successfully. Jul 10 00:49:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e9a833e1-54ee-4ba7-84ef-dcfaa2bf6ddb tempest-VolumesCloneNegativeTest-133956041 None] Lock "cinder-1d406173-eb7f-45de-b046-848c1ef0580d-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:41 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.898s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:41 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Deleted volume successfully. Jul 10 00:49:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3cc772d5-3909-4a27-88a5-4d3d31884151 tempest-VolumeAndVolumeTypeFromImageTest-1617406793 None] Lock "cinder-d4c0b902-c135-4098-ac0b-be9d7a88a46a-delete_volume" released by "delete_volume" :: held 3.899s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:42 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-513eff4e-f6a3-4335-8ad6-072ac3c9c56d req-1839c059-2e9d-450a-a575-24ba4291b0cf tempest-TestInstancesWithCinderVolumes-107754862 None] Terminate volume connection completed successfully. Jul 10 00:49:42 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-513eff4e-f6a3-4335-8ad6-072ac3c9c56d req-1839c059-2e9d-450a-a575-24ba4291b0cf tempest-TestInstancesWithCinderVolumes-107754862 None] Deleting attachment 43d243f9-9363-4738-941f-551418076f46. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:49:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "cinder-b6d1127e-ace9-4282-bb74-6e3892e2f8ce-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-b6d1127e-ace9-4282-bb74-6e3892e2f8ce-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "cinder-quobyte-b6d1127e-ace9-4282-bb74-6e3892e2f8ce" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-quobyte-b6d1127e-ace9-4282-bb74-6e3892e2f8ce" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:44 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f36a96-3d41-4e02-95c3-da76d0d33ba3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:44 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce Jul 10 00:49:44 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:45 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce" returned: 0 in 1.005s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:45 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce Jul 10 00:49:45 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Flow 'volume_create_manager' (e3ff319d-f732-4d9f-a132-6aab0790102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3707e0-3b0e-4a5d-a408-389957a1f467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3707e0-3b0e-4a5d-a408-389957a1f467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e0879a-a624-4ddc-a4a8-b6ba0c760c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45120be0b2ee480699dc7d945c735249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:46Z,use_quota=True,user_id='28eab9bbbd5f4bcd9b24b9b6f00661f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ad1523-39c8-4fa2-8a1d-a03ea2362c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ad1523-39c8-4fa2-8a1d-a03ea2362c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962e7476-e4e9-4b48-940b-3d2df581e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962e7476-e4e9-4b48-940b-3d2df581e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e0879a-a624-4ddc-a4a8-b6ba0c760c07', 'volume_name': 'volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ed5ac5-dfa0-47aa-af66-4d2816351d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ed5ac5-dfa0-47aa-af66-4d2816351d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269b2487-9b60-450b-9239-b779fea59491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Volume b8e0879a-a624-4ddc-a4a8-b6ba0c760c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07', 'volume_size': 1} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e0879a-a624-4ddc-a4a8-b6ba0c760c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45120be0b2ee480699dc7d945c735249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:46Z,use_quota=True,user_id='28eab9bbbd5f4bcd9b24b9b6f00661f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Creating volume b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:49:46 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:46 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 1073741824 Jul 10 00:49:46 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:46 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6d1127e-ace9-4282-bb74-6e3892e2f8ce" returned: 0 in 0.892s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-quobyte-b6d1127e-ace9-4282-bb74-6e3892e2f8ce" released by "delete_volume" :: held 1.962s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:46 devstack cinder-volume[87452]: WARNING cinder.quota [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1925051899-1723419490 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1925051899-1723419490, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:46 devstack cinder-volume[87452]: WARNING cinder.quota [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1925051899-1723419490 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1925051899-1723419490, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Created reservations ['dffa1d39-04e5-46c5-a201-2f16fcee16a2', 'b2398b5a-7f59-4ae2-b0af-dc73f73ddac0', '13954510-ab74-4204-a01a-5465f490df53', '687d553a-8728-45ca-ae33-55c2003b56df'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:46 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:46 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:47 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 1073741824" returned: 0 in 1.075s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:47 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 Jul 10 00:49:47 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:47 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.762s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:47 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Deleted volume successfully. Jul 10 00:49:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3d746a4d-d258-4e2c-9f78-65a9351bd2ed tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-b6d1127e-ace9-4282-bb74-6e3892e2f8ce-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:48 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07" returned: 0 in 0.738s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:49:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269b2487-9b60-450b-9239-b779fea59491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0464ac8c-fb93-4d97-a610-2d1dc186c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Volume volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 (b8e0879a-a624-4ddc-a4a8-b6ba0c760c07): created successfully Jul 10 00:49:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0464ac8c-fb93-4d97-a610-2d1dc186c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Flow 'volume_create_manager' (e3ff319d-f732-4d9f-a132-6aab0790102e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3142ed65-c565-4b8b-877d-06b6afb4499c tempest-CinderUnicodeTest-1874171683 None] Created volume successfully. Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Flow 'volume_create_manager' (9e2665eb-1f6f-46e3-82b8-270b31cda885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec61f225-703a-49c6-88ce-2db85cd1f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec61f225-703a-49c6-88ce-2db85cd1f429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1261367304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106ec14b-ae07-4eb5-9ce9-3423391ceee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45120be0b2ee480699dc7d945c735249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:50Z,use_quota=True,user_id='28eab9bbbd5f4bcd9b24b9b6f00661f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0823ba-8180-4916-99ef-c769062317be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0823ba-8180-4916-99ef-c769062317be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a237535a-976f-40fc-a2f7-cc68141f0dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a237535a-976f-40fc-a2f7-cc68141f0dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106ec14b-ae07-4eb5-9ce9-3423391ceee9', 'volume_name': 'volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fdb011-0754-4fd9-af9b-4a58aadfd018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fdb011-0754-4fd9-af9b-4a58aadfd018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb75622-e89d-4a1c-b3fb-a2cd52e034ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:50 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Volume 106ec14b-ae07-4eb5-9ce9-3423391ceee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9', 'volume_size': 1} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1261367304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106ec14b-ae07-4eb5-9ce9-3423391ceee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45120be0b2ee480699dc7d945c735249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:50Z,use_quota=True,user_id='28eab9bbbd5f4bcd9b24b9b6f00661f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Creating volume 106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:49:50 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:49:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:50 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 1073741824 Jul 10 00:49:50 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:51 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 1073741824" returned: 0 in 1.139s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:51 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 Jul 10 00:49:51 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:52 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9" returned: 0 in 0.686s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb75622-e89d-4a1c-b3fb-a2cd52e034ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59af8400-2a0d-4d0d-ae87-cfd7501d184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:52 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Volume volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 (106ec14b-ae07-4eb5-9ce9-3423391ceee9): created successfully Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59af8400-2a0d-4d0d-ae87-cfd7501d184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Flow 'volume_create_manager' (9e2665eb-1f6f-46e3-82b8-270b31cda885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:52 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-eed11ddf-34c9-45b9-bee3-b77f20aba627 tempest-CinderUnicodeTest-1874171683 None] Created volume successfully. Jul 10 00:49:52 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-7a596f2c-20fe-4f37-a341-f6c8ba4a3636 req-e1455430-1911-41a1-8769-4c6228d3c03b tempest-TestInstancesWithCinderVolumes-107754862 None] Terminate volume connection completed successfully. Jul 10 00:49:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-7a596f2c-20fe-4f37-a341-f6c8ba4a3636 req-e1455430-1911-41a1-8769-4c6228d3c03b tempest-TestInstancesWithCinderVolumes-107754862 None] Deleting attachment 3e7ebd52-9466-4d91-afd3-025b1a80c464. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Creating offline snapshot b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c of volume 106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e9bc26-34b9-4b0a-90aa-e7e0cbab45e4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:53 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:53 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:53 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 Jul 10 00:49:53 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:54 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.823s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:49:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:49:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:49:54 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9" returned: 0 in 0.940s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:54 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c 1G Jul 10 00:49:54 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:55 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c 1G" returned: 0 in 0.918s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:55 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c Jul 10 00:49:55 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:56 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" returned: 0 in 0.707s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:56 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c is being set with open permissions: ugo+rw Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:56 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c Jul 10 00:49:56 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "cinder-fb16fe5e-506d-48e9-aff9-7bedde2aebbe-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-fb16fe5e-506d-48e9-aff9-7bedde2aebbe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "cinder-quobyte-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-quobyte-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e24af19-6856-42ad-b499-68200330842c]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:56 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:49:56 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:56 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" returned: 0 in 0.816s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:56 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.info Jul 10 00:49:56 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:57 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 0 in 1.038s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:57 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:49:57 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:57 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.info" returned: 0 in 0.906s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:57 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.info is being set with open permissions: ugo+rw Jul 10 00:49:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:57 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.info Jul 10 00:49:57 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:58 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 1 in 0.994s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:49:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:58 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe Jul 10 00:49:58 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:58 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.info" returned: 0 in 0.803s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.183s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f7c36880-bf2e-4e64-a987-f8f3f9164d14 tempest-CinderUnicodeTest-1874171683 None] Create snapshot completed successfully Jul 10 00:49:59 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" returned: 0 in 0.699s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-quobyte-fb16fe5e-506d-48e9-aff9-7bedde2aebbe" released by "delete_volume" :: held 2.831s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:59 devstack cinder-volume[87452]: WARNING cinder.quota [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-394476222-1651019398 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-394476222-1651019398, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:59 devstack cinder-volume[87452]: WARNING cinder.quota [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-394476222-1651019398 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-394476222-1651019398, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Created reservations ['41c1ced3-2cf7-4319-bc0b-0a954d583b71', '6d10e553-2d31-469f-ad00-616e34bd9897', 'd41a5ada-3352-428e-bdc0-3b67afee07cd', 'e0451c24-2d7c-4e7e-bae8-d78bc4546674'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:59 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:49:59 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "cinder-b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "cinder-quobyte-106ec14b-ae07-4eb5-9ce9-3423391ceee9" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-106ec14b-ae07-4eb5-9ce9-3423391ceee9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "cinder-quobyte-b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Deleting offline snapshot b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c of volume 106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] snapshot_file for this snap is: volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b85090-a1c7-41c2-926f-c6a3e39206e6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:00 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.811s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Deleted volume successfully. Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=72,cinder:INSERT=18,cinder:UPDATE=77,cinder:DELETE=10 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d189c939-e419-4862-9d35-e871bdb82dc2 tempest-TestInstancesWithCinderVolumes-107754862 None] Lock "cinder-fb16fe5e-506d-48e9-aff9-7bedde2aebbe-delete_volume" released by "delete_volume" :: held 3.913s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:00 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c Jul 10 00:50:00 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:00 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" returned: 0 in 0.871s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d069939-1897-4858-8fc7-5122acfb8728]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:01 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 Jul 10 00:50:01 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:01 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:01 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c Jul 10 00:50:01 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:02 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" returned: 0 in 0.863s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:02 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c Jul 10 00:50:02 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:03 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9.b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" returned: 0 in 0.759s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:03 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=70,cinder:UPDATE=74,cinder:INSERT=25,cinder:DELETE=2 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:50:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c" released by "_delete_snapshot" :: held 3.500s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-106ec14b-ae07-4eb5-9ce9-3423391ceee9" released by "delete_snapshot" :: held 3.534s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:03 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Created reservations ['464d9a16-46cd-46b6-bfa6-33a0daaadd55', '5313e3dc-30d4-44fb-8cfc-a8bc9265343e', '1dd50fdd-679d-4bc7-880b-47f7cb08d994', '45a84edf-8a15-4dae-a0e0-747dad9e3d3c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Delete snapshot completed successfully. Jul 10 00:50:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3bb7cce5-f829-4946-981b-fd871450c20a tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-b0674c0d-6be2-4ce7-afc4-e2b6d47dde2c-delete_snapshot" released by "delete_snapshot" :: held 3.819s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "cinder-106ec14b-ae07-4eb5-9ce9-3423391ceee9-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-106ec14b-ae07-4eb5-9ce9-3423391ceee9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "cinder-quobyte-106ec14b-ae07-4eb5-9ce9-3423391ceee9" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-106ec14b-ae07-4eb5-9ce9-3423391ceee9" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:04 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a346b28f-354c-4221-9e2c-ac2e73f7ec9b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:04 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 Jul 10 00:50:04 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:05 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9" returned: 0 in 0.918s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:05 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9 Jul 10 00:50:05 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:06 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-106ec14b-ae07-4eb5-9ce9-3423391ceee9" returned: 0 in 0.851s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-106ec14b-ae07-4eb5-9ce9-3423391ceee9" released by "delete_volume" :: held 1.877s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Created reservations ['83a2c95c-b0d6-46c3-b679-f80de916557b', '6c60c759-fbbe-432f-8007-104b3202f267', 'c5f94cd7-beb1-4542-8b5c-1139bab528d1', '0ede1081-13b6-4fcd-bcbb-8860f8e7d498'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:06 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:06 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "cinder-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "cinder-quobyte-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2542d41e-e94b-4579-983a-f879f65a75c2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:06 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 Jul 10 00:50:06 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:07 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.914s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:07 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Deleted volume successfully. Jul 10 00:50:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee9b7fca-2b49-4e36-82cd-5879b46cada0 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-106ec14b-ae07-4eb5-9ce9-3423391ceee9-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:07 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07" returned: 0 in 1.194s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:07 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07 Jul 10 00:50:07 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:08 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07" returned: 0 in 0.738s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-quobyte-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07" released by "delete_volume" :: held 2.011s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Created reservations ['918bf72d-eaea-48c0-8e72-4b05f5d8f8d2', '19ad2b80-f00e-4e52-915b-0387260302da', '3a0e0e28-a13e-4afa-8f62-cca2840e52eb', '2edf3228-5da3-4ded-b6fa-18f97b7a6be7'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:08 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:08 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:09 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.774s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Deleted volume successfully. Jul 10 00:50:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-85912dc0-cbf1-4d9b-b86c-70ce4343b3d5 tempest-CinderUnicodeTest-1874171683 None] Lock "cinder-b8e0879a-a624-4ddc-a4a8-b6ba0c760c07-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (ac4167b1-4f8c-45fc-81f1-1140edcc3a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c3892a-54d3-4d23-823c-382fc48b24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c3892a-54d3-4d23-823c-382fc48b24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931601244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f723f49b-f53a-4b15-8549-9fe89d820c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:15Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f22cd8c-6279-46ce-baec-a27b98e0d34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f22cd8c-6279-46ce-baec-a27b98e0d34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dcba33-938f-48ca-811b-e21ae7d47bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dcba33-938f-48ca-811b-e21ae7d47bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f723f49b-f53a-4b15-8549-9fe89d820c35', 'volume_name': 'volume-f723f49b-f53a-4b15-8549-9fe89d820c35', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558db58b-645f-4e5e-a4dd-de62145413bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558db58b-645f-4e5e-a4dd-de62145413bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef69733f-d9a6-43ae-ae45-8bf4575aa9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume f723f49b-f53a-4b15-8549-9fe89d820c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f723f49b-f53a-4b15-8549-9fe89d820c35', 'volume_size': 1} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931601244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f723f49b-f53a-4b15-8549-9fe89d820c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:15Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Creating volume f723f49b-f53a-4b15-8549-9fe89d820c35 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:14 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:14 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 1073741824 Jul 10 00:50:14 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Flow 'volume_create_manager' (30b10794-d80f-40d5-9f26-f256d2987b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da4d588-9ea1-44bf-90e2-356acd980de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da4d588-9ea1-44bf-90e2-356acd980de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1361803930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a162f9-3306-4ca0-b2f5-c00599ea18e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205bc21a03cd4ca8b318298b69a456f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:15Z,use_quota=True,user_id='0bab69eecb06491aae7d4e85538090c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fb40a7-bfbb-4c1b-96d9-48bfc778f0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fb40a7-bfbb-4c1b-96d9-48bfc778f0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78188018-3704-44e5-a84e-609d606dd7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78188018-3704-44e5-a84e-609d606dd7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a162f9-3306-4ca0-b2f5-c00599ea18e2', 'volume_name': 'volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cdc478-a8f7-4f3f-84a2-fd16b567ba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cdc478-a8f7-4f3f-84a2-fd16b567ba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd36549-fb57-45ee-9fef-cb4df8d2daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:14 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Volume 94a162f9-3306-4ca0-b2f5-c00599ea18e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2', 'volume_size': 1} Jul 10 00:50:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:15 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 1073741824" returned: 0 in 1.020s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:15 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 Jul 10 00:50:15 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:16 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35" returned: 0 in 0.730s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1361803930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a162f9-3306-4ca0-b2f5-c00599ea18e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205bc21a03cd4ca8b318298b69a456f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:15Z,use_quota=True,user_id='0bab69eecb06491aae7d4e85538090c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Creating volume 94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:16 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef69733f-d9a6-43ae-ae45-8bf4575aa9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f723f49b-f53a-4b15-8549-9fe89d820c35', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c672c7-7a7a-4987-8d1b-17dc6715744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:16 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 1073741824 Jul 10 00:50:16 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:16 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume volume-f723f49b-f53a-4b15-8549-9fe89d820c35 (f723f49b-f53a-4b15-8549-9fe89d820c35): created successfully Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c672c7-7a7a-4987-8d1b-17dc6715744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:16 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (ac4167b1-4f8c-45fc-81f1-1140edcc3a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d1e33679-f2e0-41c5-8255-5462920f3dad tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created volume successfully. Jul 10 00:50:17 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 1073741824" returned: 0 in 0.871s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:17 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:50:17 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:18 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.719s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (ef403823-7465-4def-a5af-2cc0594315a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224cc389-57fb-4069-9fb9-227ce102ff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd36549-fb57-45ee-9fef-cb4df8d2daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f6d4f4-553a-4c62-b887-fa541bb52a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224cc389-57fb-4069-9fb9-227ce102ff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679989384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c790c66-ab59-4492-a566-1c3e52f57de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:18Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927db9e2-227a-490a-ba9f-91ec66c9f024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927db9e2-227a-490a-ba9f-91ec66c9f024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bb30e-f8a9-4e2e-8028-1d7684a803d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bb30e-f8a9-4e2e-8028-1d7684a803d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c790c66-ab59-4492-a566-1c3e52f57de1', 'volume_name': 'volume-0c790c66-ab59-4492-a566-1c3e52f57de1', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08d7b15-344c-4012-9970-0dc0841fbdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08d7b15-344c-4012-9970-0dc0841fbdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2284fea-e59c-42e0-8ffe-67f026a9d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume 0c790c66-ab59-4492-a566-1c3e52f57de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c790c66-ab59-4492-a566-1c3e52f57de1', 'volume_size': 1} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679989384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c790c66-ab59-4492-a566-1c3e52f57de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:18Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Creating volume 0c790c66-ab59-4492-a566-1c3e52f57de1 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:18 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Volume volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 (94a162f9-3306-4ca0-b2f5-c00599ea18e2): created successfully Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f6d4f4-553a-4c62-b887-fa541bb52a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Flow 'volume_create_manager' (30b10794-d80f-40d5-9f26-f256d2987b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:18 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-16471f41-1a66-40fd-8f4a-7b72e43b283d tempest-TestStampPattern-1065905315 None] Created volume successfully. Jul 10 00:50:18 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 1073741824 Jul 10 00:50:18 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (df76b2bd-287e-40f1-a441-5d1d84d397bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae51cd8-5450-449d-90e9-b6e792834b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae51cd8-5450-449d-90e9-b6e792834b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-270232025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9776b8-e56f-47e3-8295-b04a5e642eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:19Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b8782a-dad1-4ba1-b810-03b17debc89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b8782a-dad1-4ba1-b810-03b17debc89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef39cd0-4bd8-47e0-9760-b85e6bd66722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef39cd0-4bd8-47e0-9760-b85e6bd66722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9776b8-e56f-47e3-8295-b04a5e642eb0', 'volume_name': 'volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6a5678-cd04-43c9-acfd-d9eed22697d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6a5678-cd04-43c9-acfd-d9eed22697d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be1f272-5927-42ee-b844-4cbed264abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:18 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume 9b9776b8-e56f-47e3-8295-b04a5e642eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0', 'volume_size': 1} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (c56ec254-b247-48ea-bfcf-5d20f6570d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99831618-9eef-4347-9f65-cc0d0684dead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99831618-9eef-4347-9f65-cc0d0684dead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-994638990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d83482-b0dc-432b-8eca-b8fb1a70edb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:19Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de63c92-d467-4cab-a3a2-5eb2a22c5d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de63c92-d467-4cab-a3a2-5eb2a22c5d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f4367f-1b70-4f26-bdef-9c1fd148b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f4367f-1b70-4f26-bdef-9c1fd148b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89d83482-b0dc-432b-8eca-b8fb1a70edb7', 'volume_name': 'volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9114e8f9-1851-4ee3-9327-b1046ce3b051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9114e8f9-1851-4ee3-9327-b1046ce3b051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b137dab3-b058-40bd-a985-f88aa263421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume 89d83482-b0dc-432b-8eca-b8fb1a70edb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7', 'volume_size': 1} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (4a71d0d0-89bf-4d01-b6ab-31582f18177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a139ec6e-712f-449f-93c1-e1aa70179d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a139ec6e-712f-449f-93c1-e1aa70179d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1044026630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ee6747-cc4a-412e-a18a-a121cccf7019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:19Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22081378-0976-42b2-9b13-09b8a87dce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22081378-0976-42b2-9b13-09b8a87dce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efa85b2-387c-4e2a-913b-893b64327c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efa85b2-387c-4e2a-913b-893b64327c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ee6747-cc4a-412e-a18a-a121cccf7019', 'volume_name': 'volume-77ee6747-cc4a-412e-a18a-a121cccf7019', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b036fa-3c0a-4860-b0ac-3ef851505120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b036fa-3c0a-4860-b0ac-3ef851505120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecda3d95-e086-4f30-a503-e01487089b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume 77ee6747-cc4a-412e-a18a-a121cccf7019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ee6747-cc4a-412e-a18a-a121cccf7019', 'volume_size': 1} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 1073741824" returned: 0 in 1.202s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:19 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 Jul 10 00:50:19 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (c6e3c4af-064a-4413-be90-2ebbba2a18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd3c3e0-7a1a-4eae-9427-be00534999b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd3c3e0-7a1a-4eae-9427-be00534999b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-203010346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5894dca5-9aa1-40b2-a8c2-9f2f8d2018df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:20Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c46559-97ca-4070-9a8b-ab1348f967f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c46559-97ca-4070-9a8b-ab1348f967f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b1e07a-0056-4d5d-87f9-5c9f3a14a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b1e07a-0056-4d5d-87f9-5c9f3a14a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5894dca5-9aa1-40b2-a8c2-9f2f8d2018df', 'volume_name': 'volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7642df-8bb0-4fb3-addc-1b952e3d0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7642df-8bb0-4fb3-addc-1b952e3d0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689d5d6f-754f-4139-9fec-1cea025a24fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume 5894dca5-9aa1-40b2-a8c2-9f2f8d2018df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df', 'volume_size': 1} Jul 10 00:50:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:20 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1" returned: 0 in 0.633s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-270232025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9776b8-e56f-47e3-8295-b04a5e642eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:19Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Creating volume 9b9776b8-e56f-47e3-8295-b04a5e642eb0 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:20 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2284fea-e59c-42e0-8ffe-67f026a9d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c790c66-ab59-4492-a566-1c3e52f57de1', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:20 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 1073741824 Jul 10 00:50:20 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85fcfb6-846f-4910-ba2b-a02225da319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:20 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume volume-0c790c66-ab59-4492-a566-1c3e52f57de1 (0c790c66-ab59-4492-a566-1c3e52f57de1): created successfully Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85fcfb6-846f-4910-ba2b-a02225da319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (ef403823-7465-4def-a5af-2cc0594315a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6202a308-0265-4ab2-9176-9a55fa678a7d tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created volume successfully. Jul 10 00:50:21 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 1073741824" returned: 0 in 0.922s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:21 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 Jul 10 00:50:21 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:21 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0" returned: 0 in 0.774s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.909s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-994638990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d83482-b0dc-432b-8eca-b8fb1a70edb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:19Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Creating volume 89d83482-b0dc-432b-8eca-b8fb1a70edb7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:21 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:22 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 1073741824 Jul 10 00:50:22 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be1f272-5927-42ee-b844-4cbed264abf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143801e9-de6b-479f-be19-8c4daa0fbb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:22 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 (9b9776b8-e56f-47e3-8295-b04a5e642eb0): created successfully Jul 10 00:50:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143801e9-de6b-479f-be19-8c4daa0fbb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (df76b2bd-287e-40f1-a441-5d1d84d397bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:22 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d9d6b61a-9a7f-4aba-b150-fd7eecdc583a tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created volume successfully. Jul 10 00:50:22 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 1073741824" returned: 0 in 0.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:22 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 Jul 10 00:50:22 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:23 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7" returned: 0 in 0.652s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.042s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1044026630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ee6747-cc4a-412e-a18a-a121cccf7019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:19Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Creating volume 77ee6747-cc4a-412e-a18a-a121cccf7019 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:23 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:23 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 1073741824 Jul 10 00:50:23 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b137dab3-b058-40bd-a985-f88aa263421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc1af4a-f56b-46ea-b623-10ff21db24f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:23 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 (89d83482-b0dc-432b-8eca-b8fb1a70edb7): created successfully Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc1af4a-f56b-46ea-b623-10ff21db24f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:23 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (c56ec254-b247-48ea-bfcf-5d20f6570d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-13e23d7d-0e23-447f-9786-2fbc3d277e1f tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created volume successfully. Jul 10 00:50:24 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 1073741824" returned: 0 in 0.811s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:24 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 Jul 10 00:50:24 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:25 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019" returned: 0 in 0.620s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.149s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-203010346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5894dca5-9aa1-40b2-a8c2-9f2f8d2018df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68da24542b5e4205aa0f629325ab98f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:20Z,use_quota=True,user_id='b38b0722802a421a84bb3c7240ca028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Creating volume 5894dca5-9aa1-40b2-a8c2-9f2f8d2018df {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:25 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:25 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df 1073741824 Jul 10 00:50:25 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecda3d95-e086-4f30-a503-e01487089b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ee6747-cc4a-412e-a18a-a121cccf7019', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108f2abc-e0a3-46f2-8c7b-c25e9a983ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:25 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume volume-77ee6747-cc4a-412e-a18a-a121cccf7019 (77ee6747-cc4a-412e-a18a-a121cccf7019): created successfully Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108f2abc-e0a3-46f2-8c7b-c25e9a983ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (4a71d0d0-89bf-4d01-b6ab-31582f18177f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-84a94561-f5fd-4b10-af7d-12b9cc76b816 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created volume successfully. Jul 10 00:50:25 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df 1073741824" returned: 0 in 0.823s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:25 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df Jul 10 00:50:25 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:26 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df" returned: 0 in 0.886s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689d5d6f-754f-4139-9fec-1cea025a24fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b9b8f-a874-4b97-9618-f2a5a3e027d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:26 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Volume volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df (5894dca5-9aa1-40b2-a8c2-9f2f8d2018df): created successfully Jul 10 00:50:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b9b8f-a874-4b97-9618-f2a5a3e027d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:26 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Flow 'volume_create_manager' (c6e3c4af-064a-4413-be90-2ebbba2a18a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-830a2830-6065-4f22-af81-1b580338e444 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created volume successfully. Jul 10 00:50:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-quobyte-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c72b45-c757-4aa6-8745-ba8f6d7e3ba8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:27 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df Jul 10 00:50:27 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:28 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df" returned: 0 in 0.810s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:28 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df Jul 10 00:50:28 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:29 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df" returned: 0 in 0.667s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df" released by "delete_volume" :: held 1.530s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created reservations ['5860a630-460c-425a-a8b9-f2b4b61e8c9d', '40c4c236-7923-42f6-b029-7119d4b78a2c', '8650a697-d3c0-4d22-a5f4-cdf4215bdeae', '707f3947-85d0-4ef7-b9ed-65768c7186ef'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:29 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:29 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-77ee6747-cc4a-412e-a18a-a121cccf7019-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-77ee6747-cc4a-412e-a18a-a121cccf7019-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-quobyte-77ee6747-cc4a-412e-a18a-a121cccf7019" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-77ee6747-cc4a-412e-a18a-a121cccf7019" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c60b8-a368-4d98-a73b-fef461c97d37]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:30 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.848s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:30 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Deleted volume successfully. Jul 10 00:50:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8db77217-7007-4a89-bf22-136b1553ece6 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-5894dca5-9aa1-40b2-a8c2-9f2f8d2018df-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:30 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 Jul 10 00:50:30 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:31 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019" returned: 0 in 0.869s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:31 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019 Jul 10 00:50:31 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:31 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-77ee6747-cc4a-412e-a18a-a121cccf7019" returned: 0 in 0.735s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-77ee6747-cc4a-412e-a18a-a121cccf7019" released by "delete_volume" :: held 1.686s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created reservations ['52ea4852-037e-40d4-994c-005d3ec6f9b3', '101c4e4f-1957-4e03-a1e7-4c2ca61b945e', 'af6b2e74-c281-4aa4-b1aa-fc1c93f041df', '6c7e64c7-e4ac-4536-9c34-1059345945d4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:31 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:31 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-89d83482-b0dc-432b-8eca-b8fb1a70edb7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-89d83482-b0dc-432b-8eca-b8fb1a70edb7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-quobyte-89d83482-b0dc-432b-8eca-b8fb1a70edb7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-89d83482-b0dc-432b-8eca-b8fb1a70edb7" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b7f175-7134-4b1d-8f23-b39010b3327d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:32 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 Jul 10 00:50:32 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:32 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.850s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Deleted volume successfully. Jul 10 00:50:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-c9ea0225-0292-4bed-93d9-48c7e739d927 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-77ee6747-cc4a-412e-a18a-a121cccf7019-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:33 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7" returned: 0 in 0.971s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:33 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7 Jul 10 00:50:33 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:34 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-89d83482-b0dc-432b-8eca-b8fb1a70edb7" returned: 0 in 0.758s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-89d83482-b0dc-432b-8eca-b8fb1a70edb7" released by "delete_volume" :: held 1.789s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created reservations ['3b6980d7-7225-45fa-994b-6a192d2deb2f', '724fe696-db38-4fd9-bae9-b1e16304534b', '5efdbf3a-20d9-4c4e-9234-39003e41634f', '282eaa57-b9ed-4f3f-9960-5ca4ca778880'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:34 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:34 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-9b9776b8-e56f-47e3-8295-b04a5e642eb0-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-9b9776b8-e56f-47e3-8295-b04a5e642eb0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-quobyte-9b9776b8-e56f-47e3-8295-b04a5e642eb0" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-9b9776b8-e56f-47e3-8295-b04a5e642eb0" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[db76a338-384d-4554-bff0-6d07a0e3841a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:34 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 Jul 10 00:50:34 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:35 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.877s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:35 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Deleted volume successfully. Jul 10 00:50:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-44ed9957-481e-4fd0-a11a-c43d709e1d03 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-89d83482-b0dc-432b-8eca-b8fb1a70edb7-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:35 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0" returned: 0 in 0.929s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:35 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0 Jul 10 00:50:35 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:36 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-9b9776b8-e56f-47e3-8295-b04a5e642eb0" returned: 0 in 0.739s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-9b9776b8-e56f-47e3-8295-b04a5e642eb0" released by "delete_volume" :: held 1.723s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created reservations ['c1950c46-c596-459f-ab3a-91c8e2162d2d', 'ef3fc56b-5e6b-43f3-83a3-f3506d3b41e3', '771673e0-769f-4286-965f-870cdd7ae4f2', 'a4667de9-d896-4702-b89a-7d8a3c0b2f0e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:36 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:36 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-0c790c66-ab59-4492-a566-1c3e52f57de1-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-0c790c66-ab59-4492-a566-1c3e52f57de1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-quobyte-0c790c66-ab59-4492-a566-1c3e52f57de1" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-0c790c66-ab59-4492-a566-1c3e52f57de1" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[16599fe6-6fe9-4476-bcae-e520fa30fc93]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:37 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 Jul 10 00:50:37 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:37 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.793s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:37 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Deleted volume successfully. Jul 10 00:50:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-31e84b76-ffff-49ff-98b8-048eca29320b tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-9b9776b8-e56f-47e3-8295-b04a5e642eb0-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:37 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1" returned: 0 in 0.834s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:37 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1 Jul 10 00:50:37 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:38 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0c790c66-ab59-4492-a566-1c3e52f57de1" returned: 0 in 0.731s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-0c790c66-ab59-4492-a566-1c3e52f57de1" released by "delete_volume" :: held 1.626s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created reservations ['4a776ca0-7100-4b95-a5c9-0d5f37a79a0b', 'b26b1dd4-a282-4ef3-867b-fcb53b1642d3', '8a088b9c-635d-4765-8bd8-dd333ce939d1', '4db60dc4-5a10-477b-a132-b407bd4fb083'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:38 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:38 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-f723f49b-f53a-4b15-8549-9fe89d820c35-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-f723f49b-f53a-4b15-8549-9fe89d820c35-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "cinder-quobyte-f723f49b-f53a-4b15-8549-9fe89d820c35" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-f723f49b-f53a-4b15-8549-9fe89d820c35" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[980de769-12ad-4951-afe4-b94031f22dd0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:39 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:39 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.697s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:39 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:39 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Deleted volume successfully. Jul 10 00:50:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-fb3bd154-19f8-42ad-bf65-519dd61ffdc5 tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-0c790c66-ab59-4492-a566-1c3e52f57de1-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:40 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35" returned: 0 in 0.861s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:40 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35 Jul 10 00:50:40 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:40 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-f723f49b-f53a-4b15-8549-9fe89d820c35" returned: 0 in 0.719s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-quobyte-f723f49b-f53a-4b15-8549-9fe89d820c35" released by "delete_volume" :: held 1.626s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Created reservations ['299f9547-f481-4085-8aed-aa13f58e67ef', 'a5748072-11c9-4939-b767-a198f0928e37', 'dc2b8df6-53f5-4ff6-861a-678c95c746d1', 'a95f4b27-b103-434b-9e66-9e1c88dbc7f2'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:41 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:41 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:41 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.698s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:41 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Deleted volume successfully. Jul 10 00:50:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6a46da41-1132-4a70-b379-cae7865d5b0c tempest-CreateVolumesFromSourceVolumeTest-1902730479 None] Lock "cinder-f723f49b-f53a-4b15-8549-9fe89d820c35-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Flow 'volume_create_manager' (83cef4e7-8ad4-47c4-ae17-9211852ecddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc7c079-56c1-4b38-bb9d-b01dbbf6b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc7c079-56c1-4b38-bb9d-b01dbbf6b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-16560550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864d975c-b120-4721-91c7-ec4e4cb25ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690accd8e1cb4dd586690631b94ca3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:44Z,use_quota=True,user_id='c69e3ef5fa104afb9ea495a0a2b7b891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002cdf89-a48f-4201-80ac-cab8de5d06a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002cdf89-a48f-4201-80ac-cab8de5d06a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8e5ce-bccd-4840-826f-d924fa96c85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8e5ce-bccd-4840-826f-d924fa96c85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864d975c-b120-4721-91c7-ec4e4cb25ee8', 'volume_name': 'volume-864d975c-b120-4721-91c7-ec4e4cb25ee8', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f73066a-414d-4955-8709-8732099cd593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f73066a-414d-4955-8709-8732099cd593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560eb803-527d-4169-a49a-dacdb9a6576a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:44 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Volume 864d975c-b120-4721-91c7-ec4e4cb25ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864d975c-b120-4721-91c7-ec4e4cb25ee8', 'volume_size': 1} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-16560550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864d975c-b120-4721-91c7-ec4e4cb25ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690accd8e1cb4dd586690631b94ca3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:44Z,use_quota=True,user_id='c69e3ef5fa104afb9ea495a0a2b7b891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Creating volume 864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:44 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:44 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 1073741824 Jul 10 00:50:44 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:44 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 1073741824" returned: 0 in 0.787s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:45 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 Jul 10 00:50:45 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:45 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8" returned: 0 in 0.630s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:50:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560eb803-527d-4169-a49a-dacdb9a6576a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864d975c-b120-4721-91c7-ec4e4cb25ee8', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb4c6df-de46-40e1-b6e0-5f45f2648e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Volume volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 (864d975c-b120-4721-91c7-ec4e4cb25ee8): created successfully Jul 10 00:50:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb4c6df-de46-40e1-b6e0-5f45f2648e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Flow 'volume_create_manager' (83cef4e7-8ad4-47c4-ae17-9211852ecddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c6e31cc4-64c9-4caf-8410-15bb507a1354 tempest-VolumeDependencyTests-1983542509 None] Created volume successfully. Jul 10 00:50:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Creating offline snapshot d73c54f1-bdb4-4161-9145-5e11424c5aca of volume 864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:50:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[35be9e9f-5e29-438c-b1a2-8dcecee0f71e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:46 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 Jul 10 00:50:46 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:47 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8" returned: 0 in 0.820s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:47 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca 1G Jul 10 00:50:47 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:48 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca 1G" returned: 0 in 0.843s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:48 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca Jul 10 00:50:48 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:48 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca" returned: 0 in 0.678s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:48 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca is being set with open permissions: ugo+rw Jul 10 00:50:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:48 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca Jul 10 00:50:48 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:49 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca" returned: 0 in 0.636s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:49 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.info Jul 10 00:50:49 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:49 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.info" returned: 0 in 0.615s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:49 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.info is being set with open permissions: ugo+rw Jul 10 00:50:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:50 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.info Jul 10 00:50:50 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:50 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.info" returned: 0 in 0.617s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.296s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:50 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-612aaf10-0e28-4aab-a836-dc006a3d530a tempest-VolumeDependencyTests-1983542509 None] Create snapshot completed successfully Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Flow 'volume_create_manager' (637825ee-9c71-41fe-a05b-8c3ad9b91eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0809e5ea-397e-4e9a-9d8c-6d02b46dec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0809e5ea-397e-4e9a-9d8c-6d02b46dec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1742117015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a6502e-4354-47e7-8efd-1b339377390b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690accd8e1cb4dd586690631b94ca3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d73c54f1-bdb4-4161-9145-5e11424c5aca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:50:52Z,use_quota=True,user_id='c69e3ef5fa104afb9ea495a0a2b7b891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97148e67-1173-4ee0-ade8-60be29375f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97148e67-1173-4ee0-ade8-60be29375f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424269f7-4633-433b-b509-dfeb2eab004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424269f7-4633-433b-b509-dfeb2eab004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0a6502e-4354-47e7-8efd-1b339377390b', 'volume_name': 'volume-e0a6502e-4354-47e7-8efd-1b339377390b', 'volume_size': 1, 'snapshot_id': 'd73c54f1-bdb4-4161-9145-5e11424c5aca'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b140c64f-ffb8-40fb-8822-f76c7ef20608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b140c64f-ffb8-40fb-8822-f76c7ef20608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb3cd57-cc59-4650-9862-32722fafcaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:50:52 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Volume e0a6502e-4354-47e7-8efd-1b339377390b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0a6502e-4354-47e7-8efd-1b339377390b', 'volume_size': 1, 'snapshot_id': 'd73c54f1-bdb4-4161-9145-5e11424c5aca'} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-quobyte-d73c54f1-bdb4-4161-9145-5e11424c5aca-e0a6502e-4354-47e7-8efd-1b339377390b" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-d73c54f1-bdb4-4161-9145-5e11424c5aca-e0a6502e-4354-47e7-8efd-1b339377390b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Creating volume e0a6502e-4354-47e7-8efd-1b339377390b from snapshot d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-quobyte-e0a6502e-4354-47e7-8efd-1b339377390b" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-e0a6502e-4354-47e7-8efd-1b339377390b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] snapshot: d73c54f1-bdb4-4161-9145-5e11424c5aca, volume: e0a6502e-4354-47e7-8efd-1b339377390b, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[905ebb2e-5228-4d3f-90c0-ec49ed1d3ba0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:52 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca Jul 10 00:50:52 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:53 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca" returned: 0 in 0.815s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864d975c-b120-4721-91c7-ec4e4cb25ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aaf47c-e90f-4a9c-91ac-5ea12414344c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:53 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 Jul 10 00:50:53 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:53 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:50:53 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:53 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8" returned: 0 in 0.822s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:50:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:53 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b Jul 10 00:50:53 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:54 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.699s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:50:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:50:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:50:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:50:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f6fb1fca-e127-48fc-80b5-98441429f1f2 req-d99b851f-9271-46cb-a89e-e00cb965f91a tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:50:58 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b" returned: 0 in 4.661s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7283b80a-14b3-49b3-8096-99e227eec12b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:50:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:58 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 Jul 10 00:50:58 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:50:59 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 10 00:50:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8" returned: 0 in 0.891s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:50:59 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:50:59 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Converted 1024.00 MB image at 219.64 MB/s Jul 10 00:50:59 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b is being set with open permissions: ugo+rw Jul 10 00:50:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:50:59 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b Jul 10 00:50:59 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:00 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b" returned: 0 in 0.643s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-e0a6502e-4354-47e7-8efd-1b339377390b" released by "_copy_volume_from_snapshot" :: held 7.920s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-d73c54f1-bdb4-4161-9145-5e11424c5aca-e0a6502e-4354-47e7-8efd-1b339377390b" released by "_create_volume_from_snapshot" :: held 7.948s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.963s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f6fb1fca-e127-48fc-80b5-98441429f1f2 req-d99b851f-9271-46cb-a89e-e00cb965f91a tempest-TestStampPattern-1065905315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.250s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abecbcc-eb27-48aa-afee-682bcd17ad7a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6fb1fca-e127-48fc-80b5-98441429f1f2 req-d99b851f-9271-46cb-a89e-e00cb965f91a tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb3cd57-cc59-4650-9862-32722fafcaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a6502e-4354-47e7-8efd-1b339377390b', 'volume_size': 1, 'snapshot_id': 'd73c54f1-bdb4-4161-9145-5e11424c5aca'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8eae40-882f-4b6e-a16a-b7f40c8ee813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:51:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Volume volume-e0a6502e-4354-47e7-8efd-1b339377390b (e0a6502e-4354-47e7-8efd-1b339377390b): created successfully Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8eae40-882f-4b6e-a16a-b7f40c8ee813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Flow 'volume_create_manager' (637825ee-9c71-41fe-a05b-8c3ad9b91eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:51:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-595e7762-7de7-4aff-a7aa-9313e29c4620 tempest-VolumeDependencyTests-1983542509 None] Created volume successfully. Jul 10 00:51:00 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:51:00 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-d73c54f1-bdb4-4161-9145-5e11424c5aca-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-d73c54f1-bdb4-4161-9145-5e11424c5aca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-quobyte-864d975c-b120-4721-91c7-ec4e4cb25ee8" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-864d975c-b120-4721-91c7-ec4e4cb25ee8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-quobyte-d73c54f1-bdb4-4161-9145-5e11424c5aca" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-d73c54f1-bdb4-4161-9145-5e11424c5aca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Deleting offline snapshot d73c54f1-bdb4-4161-9145-5e11424c5aca of volume 864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] snapshot_file for this snap is: volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ac7513-210b-4658-a423-8ffacad24aea]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:00 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-f6fb1fca-e127-48fc-80b5-98441429f1f2 req-d99b851f-9271-46cb-a89e-e00cb965f91a tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.749s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-f6fb1fca-e127-48fc-80b5-98441429f1f2 req-d99b851f-9271-46cb-a89e-e00cb965f91a tempest-TestStampPattern-1065905315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=66,cinder:INSERT=21,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:51:00 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca Jul 10 00:51:00 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-f6fb1fca-e127-48fc-80b5-98441429f1f2 req-d99b851f-9271-46cb-a89e-e00cb965f91a tempest-TestStampPattern-1065905315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6aaf9577-5b20-423c-943e-7e6a1f302e7c', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:51:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-f6fb1fca-e127-48fc-80b5-98441429f1f2 req-d99b851f-9271-46cb-a89e-e00cb965f91a tempest-TestStampPattern-1065905315 None] attachment_update completed successfully. Jul 10 00:51:01 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca" returned: 0 in 0.754s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864d975c-b120-4721-91c7-ec4e4cb25ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:51:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b8920d-2747-41d0-8722-289a35b65313]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:01 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 Jul 10 00:51:01 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:02 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8" returned: 0 in 0.808s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:02 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca Jul 10 00:51:02 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:03 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca" returned: 0 in 0.708s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:03 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca Jul 10 00:51:03 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:03 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8.d73c54f1-bdb4-4161-9145-5e11424c5aca" returned: 0 in 0.648s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=77,cinder:INSERT=24,cinder:UPDATE=99,cinder:DELETE=9 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-d73c54f1-bdb4-4161-9145-5e11424c5aca" released by "_delete_snapshot" :: held 3.026s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-864d975c-b120-4721-91c7-ec4e4cb25ee8" released by "delete_snapshot" :: held 3.057s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Created reservations ['51d6b38e-4975-4312-9611-c6827f6f8773', 'd766b3b4-74b2-4dc9-86ed-f99623434793', '4f675c79-9aa7-4a51-8b33-2f18de8831f3', 'b79b7279-758f-4874-81da-5735af56e4a6'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:51:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Delete snapshot completed successfully. Jul 10 00:51:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a47c90a9-846e-431f-b6cd-3dff52b1643a tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-d73c54f1-bdb4-4161-9145-5e11424c5aca-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-864d975c-b120-4721-91c7-ec4e4cb25ee8-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-864d975c-b120-4721-91c7-ec4e4cb25ee8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-quobyte-864d975c-b120-4721-91c7-ec4e4cb25ee8" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-864d975c-b120-4721-91c7-ec4e4cb25ee8" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:05 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4928e76d-e9e4-4982-b0f3-1d1cdea49382]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:05 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 Jul 10 00:51:05 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:05 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8" returned: 0 in 0.732s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:05 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8 Jul 10 00:51:05 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:06 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-864d975c-b120-4721-91c7-ec4e4cb25ee8" returned: 0 in 0.627s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-864d975c-b120-4721-91c7-ec4e4cb25ee8" released by "delete_volume" :: held 1.413s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Created reservations ['20ded3fc-f63a-4b4a-8b6d-75d36eeea3a5', '5addea59-921a-4572-9e7a-d12834348846', 'a865fb34-3ad5-4db8-8a68-488d0f8436c7', '10e73d5f-2ac2-4a1a-b63f-54f1aabab00f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:06 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:51:06 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-e0a6502e-4354-47e7-8efd-1b339377390b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-e0a6502e-4354-47e7-8efd-1b339377390b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:07 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.687s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:51:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Deleted volume successfully. Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "cinder-quobyte-e0a6502e-4354-47e7-8efd-1b339377390b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1fa411df-27cf-43bb-9467-94eaaf76f7b7 tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-864d975c-b120-4721-91c7-ec4e4cb25ee8-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-e0a6502e-4354-47e7-8efd-1b339377390b" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b60b6a-a160-4c6d-b58a-e9deba057a28]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:07 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b Jul 10 00:51:07 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:08 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b" returned: 0 in 0.783s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:08 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b Jul 10 00:51:08 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:08 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e0a6502e-4354-47e7-8efd-1b339377390b" returned: 0 in 0.667s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-quobyte-e0a6502e-4354-47e7-8efd-1b339377390b" released by "delete_volume" :: held 1.489s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Created reservations ['7b2839ec-6d7c-49ab-921d-cb7460accbb8', '6fa2f331-c87a-402b-bab8-1b304f02181a', '717d870a-ddf1-4bb7-b038-2bb407b71033', 'd3da2d42-e618-44e4-8b22-6373ef9b9b88'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:08 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:51:08 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:09 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.655s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:51:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Deleted volume successfully. Jul 10 00:51:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-177b6acc-d196-4999-b937-04092b3cebba tempest-VolumeDependencyTests-1983542509 None] Lock "cinder-e0a6502e-4354-47e7-8efd-1b339377390b-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-a5e3ed3b-c72c-4de3-9983-5ded3261a1c9 req-1fe64132-fbb8-486c-bb72-cb01cfa74f33 tempest-TestStampPattern-1065905315 None] Terminate volume connection completed successfully. Jul 10 00:51:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-a5e3ed3b-c72c-4de3-9983-5ded3261a1c9 req-1fe64132-fbb8-486c-bb72-cb01cfa74f33 tempest-TestStampPattern-1065905315 None] Deleting attachment 6aaf9577-5b20-423c-943e-7e6a1f302e7c. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:51:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:51:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Creating offline snapshot 1f048598-6994-4448-bd6f-2385a7c89b24 of volume 94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:51:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[855dfc57-c7e5-48e7-9e2c-e2811a7ba7ef]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:12 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:51:12 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:13 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.714s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:13 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 1G Jul 10 00:51:13 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:14 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 1G" returned: 0 in 0.761s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:14 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 Jul 10 00:51:14 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:14 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24" returned: 0 in 0.663s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:14 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 is being set with open permissions: ugo+rw Jul 10 00:51:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:14 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 Jul 10 00:51:14 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:15 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24" returned: 0 in 0.625s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:15 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.info Jul 10 00:51:15 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:16 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.info" returned: 0 in 0.643s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:16 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.info is being set with open permissions: ugo+rw Jul 10 00:51:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:16 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.info Jul 10 00:51:16 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:16 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.info" returned: 0 in 0.622s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.112s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3b964153-ee47-4bee-b761-06ee32b9a2ff tempest-TestStampPattern-1065905315 None] Create snapshot completed successfully Jul 10 00:51:26 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:51:26 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=24,cinder:SELECT=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Flow 'volume_create_manager' (0ca0139f-c539-4bc0-95e3-aeedc8c4d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40720639-b9d8-4e46-83fd-14fc762b3585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40720639-b9d8-4e46-83fd-14fc762b3585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-239933001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205bc21a03cd4ca8b318298b69a456f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f048598-6994-4448-bd6f-2385a7c89b24,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:51:28Z,use_quota=True,user_id='0bab69eecb06491aae7d4e85538090c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf79df9-ea5d-4d80-8542-8eb0df71e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf79df9-ea5d-4d80-8542-8eb0df71e446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef86f46c-d392-44de-999f-c7787c7fae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef86f46c-d392-44de-999f-c7787c7fae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26', 'volume_name': 'volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26', 'volume_size': 1, 'snapshot_id': '1f048598-6994-4448-bd6f-2385a7c89b24'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18119f19-8985-4edc-8da8-dc93c1847453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18119f19-8985-4edc-8da8-dc93c1847453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ea6df6-54e6-4b76-bceb-7d9ac6271483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:51:27 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Volume c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26', 'volume_size': 1, 'snapshot_id': '1f048598-6994-4448-bd6f-2385a7c89b24'} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-quobyte-1f048598-6994-4448-bd6f-2385a7c89b24-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-1f048598-6994-4448-bd6f-2385a7c89b24-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Creating volume c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 from snapshot 1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-quobyte-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] snapshot: 1f048598-6994-4448-bd6f-2385a7c89b24, volume: c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b459e-6013-4ddb-95c2-460da14b6cd6]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:27 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 Jul 10 00:51:27 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:28 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24" returned: 0 in 0.814s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:51:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:51:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:51:28 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adfd9b3-c632-4abd-8846-de5a71db157a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:28 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:51:28 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:29 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.772s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:29 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:51:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:29 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 Jul 10 00:51:29 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:34 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" returned: 0 in 4.601s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:34 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d10c47-0898-453a-b419-37a3d5accf24]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:51:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:34 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:51:34 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:34 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.916s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:34 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:51:34 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Converted 1024.00 MB image at 222.51 MB/s Jul 10 00:51:34 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 is being set with open permissions: ugo+rw Jul 10 00:51:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:34 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 Jul 10 00:51:34 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:35 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" returned: 0 in 0.685s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" released by "_copy_volume_from_snapshot" :: held 7.890s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-1f048598-6994-4448-bd6f-2385a7c89b24-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" released by "_create_volume_from_snapshot" :: held 7.920s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.942s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ea6df6-54e6-4b76-bceb-7d9ac6271483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26', 'volume_size': 1, 'snapshot_id': '1f048598-6994-4448-bd6f-2385a7c89b24'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67a047f-890e-45cb-b884-be03021f6184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:51:35 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Volume volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 (c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26): created successfully Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67a047f-890e-45cb-b884-be03021f6184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:51:35 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Flow 'volume_create_manager' (0ca0139f-c539-4bc0-95e3-aeedc8c4d053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:51:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e85032c3-9676-4c56-b10b-5adbe7c7f40a tempest-TestStampPattern-1065905315 None] Created volume successfully. Jul 10 00:51:45 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:51:45 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:51:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:51:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:51:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:51:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:51:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:51:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:51:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:51:53 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:51:53 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:51:54 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 10 00:51:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.683s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:51:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:51:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:51:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:51:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:52:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-239f33cc-39bf-439c-90c3-f33c377ab462 req-6804fda4-f0a6-40b6-8c42-ab11130ec574 tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-239f33cc-39bf-439c-90c3-f33c377ab462 req-6804fda4-f0a6-40b6-8c42-ab11130ec574 tempest-TestStampPattern-1065905315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:09 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1a7c9a-4460-49ea-9e11-493656d349de]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:52:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-239f33cc-39bf-439c-90c3-f33c377ab462 req-6804fda4-f0a6-40b6-8c42-ab11130ec574 tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:09 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 Jul 10 00:52:09 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:10 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [req-239f33cc-39bf-439c-90c3-f33c377ab462 req-6804fda4-f0a6-40b6-8c42-ab11130ec574 tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [req-239f33cc-39bf-439c-90c3-f33c377ab462 req-6804fda4-f0a6-40b6-8c42-ab11130ec574 tempest-TestStampPattern-1065905315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.733s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-239f33cc-39bf-439c-90c3-f33c377ab462 req-6804fda4-f0a6-40b6-8c42-ab11130ec574 tempest-TestStampPattern-1065905315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df', 'name': 'volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f464d1cb-6977-4ce2-8887-ad4efa49970d', 'enforce_multipath': True} {{(pid=87452) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 00:52:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-239f33cc-39bf-439c-90c3-f33c377ab462 req-6804fda4-f0a6-40b6-8c42-ab11130ec574 tempest-TestStampPattern-1065905315 None] attachment_update completed successfully. Jul 10 00:52:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [req-0642a290-3223-4f1a-a255-f85cd93fdeb6 req-6b8d4cf4-cb5b-48f5-b570-b481e91aac0f tempest-TestStampPattern-1065905315 None] Terminate volume connection completed successfully. Jul 10 00:52:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [req-0642a290-3223-4f1a-a255-f85cd93fdeb6 req-6b8d4cf4-cb5b-48f5-b570-b481e91aac0f tempest-TestStampPattern-1065905315 None] Deleting attachment f464d1cb-6977-4ce2-8887-ad4efa49970d. {{(pid=87452) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 00:52:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:52:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Lock "cinder-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:52:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-quobyte-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:52:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" acquired by "delete_volume" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:52:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8632c721-be73-458b-a698-270d22ae81e7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:52:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:27 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 Jul 10 00:52:27 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:27 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:27 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26 Jul 10 00:52:27 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:28 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" returned: 0 in 0.601s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26" released by "delete_volume" :: held 1.351s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Created reservations ['be929b62-d200-41a0-8337-47a398221dc6', '0e18ee08-c176-4592-8be1-917e723f03fe', '6d9b67dd-73ef-4fc2-b452-7767a11c76c1', 'af57b62d-a553-4c85-97e8-2809ecf15c40'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:28 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:52:28 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:29 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.628s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:52:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Deleted volume successfully. Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e34c00dc-c8ad-491b-8f48-4fa7d3c5bb96 tempest-TestStampPattern-1065905315 None] Lock "cinder-c6fe8ae2-89a8-4c7f-b464-b3e6afb69b26-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-1f048598-6994-4448-bd6f-2385a7c89b24-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Lock "cinder-1f048598-6994-4448-bd6f-2385a7c89b24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-quobyte-94a162f9-3306-4ca0-b2f5-c00599ea18e2" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-94a162f9-3306-4ca0-b2f5-c00599ea18e2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-quobyte-1f048598-6994-4448-bd6f-2385a7c89b24" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-1f048598-6994-4448-bd6f-2385a7c89b24" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Deleting offline snapshot 1f048598-6994-4448-bd6f-2385a7c89b24 of volume 94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] snapshot_file for this snap is: volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed62017-a704-47a7-9e2b-890e1781d82d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:52:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:29 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 Jul 10 00:52:29 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:30 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24" returned: 0 in 0.715s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:52:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef0ec25-c27a-4925-b518-3074135b2f46]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:52:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:30 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:52:30 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:30 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.719s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:30 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 Jul 10 00:52:30 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:31 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24" returned: 0 in 0.722s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:31 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24 Jul 10 00:52:31 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:32 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2.1f048598-6994-4448-bd6f-2385a7c89b24" returned: 0 in 0.625s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-1f048598-6994-4448-bd6f-2385a7c89b24" released by "_delete_snapshot" :: held 2.877s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:52:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-94a162f9-3306-4ca0-b2f5-c00599ea18e2" released by "delete_snapshot" :: held 2.896s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:52:32 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Created reservations ['6079254d-40e9-4a12-8a64-45844e7d7c01', 'aa6bedce-0ed8-4600-aa5f-43ac97c6b3ff', 'e782698c-4152-4e50-8f74-54be667b0689', '2b34110f-2987-4153-8070-884539374ff8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:52:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Delete snapshot completed successfully. Jul 10 00:52:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5d21a794-dbb1-4d7f-b45d-8ba5cce1068d tempest-TestStampPattern-1065905315 None] Lock "cinder-1f048598-6994-4448-bd6f-2385a7c89b24-delete_snapshot" released by "delete_snapshot" :: held 3.028s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:52:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-94a162f9-3306-4ca0-b2f5-c00599ea18e2-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:52:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Lock "cinder-94a162f9-3306-4ca0-b2f5-c00599ea18e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:52:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Acquiring lock "cinder-quobyte-94a162f9-3306-4ca0-b2f5-c00599ea18e2" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:52:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-94a162f9-3306-4ca0-b2f5-c00599ea18e2" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:52:40 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824fc54-f904-4417-b808-46d93fe7615b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:52:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:40 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:52:40 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:41 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.751s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:41 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2 Jul 10 00:52:41 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:42 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-94a162f9-3306-4ca0-b2f5-c00599ea18e2" returned: 0 in 0.603s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Lock "cinder-quobyte-94a162f9-3306-4ca0-b2f5-c00599ea18e2" released by "delete_volume" :: held 1.410s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Created reservations ['fd70a2fd-b623-426e-8f7e-7751b7ae1ea8', '81b113f9-baf9-45a6-ae62-7872d008caa3', 'aa6692cc-f123-4ca3-ac5c-c27659c488b2', 'a2e8e9d6-8687-47a8-ba6d-a52350ec0b7b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:42 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:52:42 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:42 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.631s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:52:42 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Deleted volume successfully. Jul 10 00:52:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6ab28021-90ad-4c04-b230-5cb5b73034ec tempest-TestStampPattern-1065905315 None] Lock "cinder-94a162f9-3306-4ca0-b2f5-c00599ea18e2-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:52:52 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:52:52 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (c70e2b3c-b46d-408d-a32f-40458a5ea0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b2f787-1a4c-451e-b195-d2abc8571bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b2f787-1a4c-451e-b195-d2abc8571bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740138327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaa7988-3d63-483e-a9c4-afda3a9b94fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:53Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a270186-e330-4faa-9582-bc3193d6ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a270186-e330-4faa-9582-bc3193d6ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314c6efa-0cc7-4356-8faf-d50431983e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314c6efa-0cc7-4356-8faf-d50431983e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfaa7988-3d63-483e-a9c4-afda3a9b94fa', 'volume_name': 'volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0509a4-f082-4c7c-9d7b-df97ba1ad97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0509a4-f082-4c7c-9d7b-df97ba1ad97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279e543c-6af1-42f8-8a1e-81bf79c86ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Volume cfaa7988-3d63-483e-a9c4-afda3a9b94fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa', 'volume_size': 1} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740138327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaa7988-3d63-483e-a9c4-afda3a9b94fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:53Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Creating volume cfaa7988-3d63-483e-a9c4-afda3a9b94fa {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:52:53 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:53 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa 1073741824 Jul 10 00:52:53 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (0af97599-15ea-43cd-bc2f-6f4c331d4db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcda0ac-f37a-4bb1-b497-63f832302a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcda0ac-f37a-4bb1-b497-63f832302a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1406322973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc94f9b9-6527-4078-bcbc-91b6d7a88190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:53Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeee96a6-788e-4f74-8f5c-2f5da5178e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeee96a6-788e-4f74-8f5c-2f5da5178e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5109c66b-e3dd-45c0-a6ae-3a9d9a58dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5109c66b-e3dd-45c0-a6ae-3a9d9a58dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc94f9b9-6527-4078-bcbc-91b6d7a88190', 'volume_name': 'volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151500bb-5c8d-4637-b6cd-91344a33d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151500bb-5c8d-4637-b6cd-91344a33d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d574bb34-2b0c-4b1d-ad05-a750ad420a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Volume fc94f9b9-6527-4078-bcbc-91b6d7a88190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190', 'volume_size': 1} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:53 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:52:53 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (35dea213-6f2f-4536-98de-db07a0bef1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4236c8f-5e51-47d2-ac54-ced6a1d41db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4236c8f-5e51-47d2-ac54-ced6a1d41db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2090340031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bf6c93-230d-47e8-bc09-76ec1401097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:54Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fd65f3-3bd5-4426-a9e3-cb7ab4013e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fd65f3-3bd5-4426-a9e3-cb7ab4013e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a539a5f1-c7d1-4b87-99c1-d82ccb5d7b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a539a5f1-c7d1-4b87-99c1-d82ccb5d7b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44bf6c93-230d-47e8-bc09-76ec1401097c', 'volume_name': 'volume-44bf6c93-230d-47e8-bc09-76ec1401097c', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdae7ef-2cf6-4f82-8562-9e50c39317da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdae7ef-2cf6-4f82-8562-9e50c39317da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e96287-b5e9-4950-b2f5-956f3d2e2f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:53 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Volume 44bf6c93-230d-47e8-bc09-76ec1401097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44bf6c93-230d-47e8-bc09-76ec1401097c', 'volume_size': 1} Jul 10 00:52:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:54 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa 1073741824" returned: 0 in 0.998s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (58821e6a-fc9e-45d2-8316-740c3cd2c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4751df-07b7-4d40-8595-20cf32efdc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4751df-07b7-4d40-8595-20cf32efdc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118252860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02a90a6-ef71-4eda-b964-b8fbf24b5686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:54Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6029a1ce-6f82-46f1-b988-5b4c2b841dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6029a1ce-6f82-46f1-b988-5b4c2b841dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdaa6a4-b397-4fa3-a52c-afff89cc5652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdaa6a4-b397-4fa3-a52c-afff89cc5652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b02a90a6-ef71-4eda-b964-b8fbf24b5686', 'volume_name': 'volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c2ffd2-802f-44f6-970f-4aa51550b52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c2ffd2-802f-44f6-970f-4aa51550b52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e433702-5fa0-489b-b50c-bb41f2fc69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Volume b02a90a6-ef71-4eda-b964-b8fbf24b5686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686', 'volume_size': 1} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:54 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.751s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:52:54 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa Jul 10 00:52:54 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (007071a5-9f68-4e6f-ad64-6962607f33d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2890c34-0c93-4a66-94d1-ff6536b4de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2890c34-0c93-4a66-94d1-ff6536b4de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317807312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9409c6f-7d1d-478f-9900-120822e6ffd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:55Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043cdfb1-be71-4574-9e1f-8da09580036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043cdfb1-be71-4574-9e1f-8da09580036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ae754b-b165-49d0-be13-8afab3e2c919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ae754b-b165-49d0-be13-8afab3e2c919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9409c6f-7d1d-478f-9900-120822e6ffd2', 'volume_name': 'volume-b9409c6f-7d1d-478f-9900-120822e6ffd2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6601165-91c6-47b6-9245-2d92e8a59a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6601165-91c6-47b6-9245-2d92e8a59a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b162a8ba-e272-4f34-8641-2f026df8de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Volume b9409c6f-7d1d-478f-9900-120822e6ffd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9409c6f-7d1d-478f-9900-120822e6ffd2', 'volume_size': 1} Jul 10 00:52:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:55 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa" returned: 0 in 0.687s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1406322973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc94f9b9-6527-4078-bcbc-91b6d7a88190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:53Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Creating volume fc94f9b9-6527-4078-bcbc-91b6d7a88190 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:52:55 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:55 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 1073741824 Jul 10 00:52:55 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279e543c-6af1-42f8-8a1e-81bf79c86ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7600cc33-0c38-48b9-b5b6-dc32d82f1b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Volume volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa (cfaa7988-3d63-483e-a9c4-afda3a9b94fa): created successfully Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7600cc33-0c38-48b9-b5b6-dc32d82f1b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (c70e2b3c-b46d-408d-a32f-40458a5ea0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:55 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f10307ce-1ccc-4389-ad68-665ccd4bf3fd tempest-CreateVolumesFromImageTest-1227766729 None] Created volume successfully. Jul 10 00:52:55 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 1073741824" returned: 0 in 0.835s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:55 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 Jul 10 00:52:55 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:56 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190" returned: 0 in 0.628s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.576s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2090340031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bf6c93-230d-47e8-bc09-76ec1401097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:54Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Creating volume 44bf6c93-230d-47e8-bc09-76ec1401097c {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:52:56 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:56 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c 1073741824 Jul 10 00:52:56 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d574bb34-2b0c-4b1d-ad05-a750ad420a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed4c750-b5fd-4ec7-82cc-20faaea8ada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Volume volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 (fc94f9b9-6527-4078-bcbc-91b6d7a88190): created successfully Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed4c750-b5fd-4ec7-82cc-20faaea8ada1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (0af97599-15ea-43cd-bc2f-6f4c331d4db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d5b51cba-9460-4d11-a29c-3f379e210771 tempest-CreateVolumesFromImageTest-1227766729 None] Created volume successfully. Jul 10 00:52:57 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c 1073741824" returned: 0 in 0.789s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:57 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c Jul 10 00:52:57 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:58 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c" returned: 0 in 0.619s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.672s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118252860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02a90a6-ef71-4eda-b964-b8fbf24b5686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:54Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Creating volume b02a90a6-ef71-4eda-b964-b8fbf24b5686 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:52:58 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:58 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 1073741824 Jul 10 00:52:58 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e96287-b5e9-4950-b2f5-956f3d2e2f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bf6c93-230d-47e8-bc09-76ec1401097c', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b32418-be08-485c-9226-8407ded7ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Volume volume-44bf6c93-230d-47e8-bc09-76ec1401097c (44bf6c93-230d-47e8-bc09-76ec1401097c): created successfully Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b32418-be08-485c-9226-8407ded7ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (35dea213-6f2f-4536-98de-db07a0bef1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-00eb84e9-7362-45b8-be21-88ae721f4fe8 tempest-CreateVolumesFromImageTest-1227766729 None] Created volume successfully. Jul 10 00:52:58 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 1073741824" returned: 0 in 0.781s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:58 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 Jul 10 00:52:58 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:59 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686" returned: 0 in 0.615s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.737s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317807312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9409c6f-7d1d-478f-9900-120822e6ffd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f80aa419b644931837e3a8fa4b4e218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:52:55Z,use_quota=True,user_id='dd9dd25825ec42228a4f3c195467b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Creating volume b9409c6f-7d1d-478f-9900-120822e6ffd2 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:52:59 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e433702-5fa0-489b-b50c-bb41f2fc69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842cfe5e-3df8-4d3a-833d-5f6d428c3f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:52:59 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 1073741824 Jul 10 00:52:59 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:52:59 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Volume volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 (b02a90a6-ef71-4eda-b964-b8fbf24b5686): created successfully Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842cfe5e-3df8-4d3a-833d-5f6d428c3f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:52:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (58821e6a-fc9e-45d2-8316-740c3cd2c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:52:59 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7a9d8c74-3b75-41a9-a8b8-062354a81d1a tempest-CreateVolumesFromImageTest-1227766729 None] Created volume successfully. Jul 10 00:53:00 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 1073741824" returned: 0 in 0.781s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:00 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 Jul 10 00:53:00 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:00 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2" returned: 0 in 0.632s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b162a8ba-e272-4f34-8641-2f026df8de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9409c6f-7d1d-478f-9900-120822e6ffd2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fab37a-2ac0-4c06-a033-515d60f19716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Volume volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 (b9409c6f-7d1d-478f-9900-120822e6ffd2): created successfully Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fab37a-2ac0-4c06-a033-515d60f19716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Flow 'volume_create_manager' (007071a5-9f68-4e6f-ad64-6962607f33d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2d0cbf11-97b6-4d74-8434-85aa39d5d081 tempest-CreateVolumesFromImageTest-1227766729 None] Created volume successfully. Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-b9409c6f-7d1d-478f-9900-120822e6ffd2-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-b9409c6f-7d1d-478f-9900-120822e6ffd2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-quobyte-b9409c6f-7d1d-478f-9900-120822e6ffd2" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-b9409c6f-7d1d-478f-9900-120822e6ffd2" acquired by "delete_volume" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cf0fb6-c6ef-4789-b5b0-f558d9cc20b9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:01 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 Jul 10 00:53:01 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:01 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2" returned: 0 in 0.732s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:02 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2 Jul 10 00:53:02 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:02 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b9409c6f-7d1d-478f-9900-120822e6ffd2" returned: 0 in 0.628s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-b9409c6f-7d1d-478f-9900-120822e6ffd2" released by "delete_volume" :: held 1.404s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Created reservations ['ff248d68-4678-4439-815f-5a48b47bbd2a', 'a82a86ef-74cb-403a-baf2-e7a0accd2720', '6eb07fb9-f4ef-4e26-a431-2d5427f38290', '141d4004-afa8-4705-a14b-e3f0e930af63'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:02 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:53:02 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:03 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.637s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:53:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Deleted volume successfully. Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-b02a90a6-ef71-4eda-b964-b8fbf24b5686-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-b02a90a6-ef71-4eda-b964-b8fbf24b5686-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-482265b4-7cc4-426f-a8f7-682c66c249bd tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-b9409c6f-7d1d-478f-9900-120822e6ffd2-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-quobyte-b02a90a6-ef71-4eda-b964-b8fbf24b5686" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-b02a90a6-ef71-4eda-b964-b8fbf24b5686" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[be147d21-4565-4eef-8e2c-fff1e331b5a5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:03 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 Jul 10 00:53:03 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:04 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686" returned: 0 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:04 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686 Jul 10 00:53:04 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:04 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b02a90a6-ef71-4eda-b964-b8fbf24b5686" returned: 0 in 0.618s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-b02a90a6-ef71-4eda-b964-b8fbf24b5686" released by "delete_volume" :: held 1.399s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Created reservations ['8abf98d6-bb10-47e3-bd9f-26fd0c83dcbf', 'acb0d00d-4753-4eb1-9a42-3c6f166fbf89', '3fe2ab43-01c1-4292-9820-c63aa621e5f0', '3e2e3581-13aa-49c6-a981-834d7d9545cb'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:05 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:53:05 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:05 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.642s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:53:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Deleted volume successfully. Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-44bf6c93-230d-47e8-bc09-76ec1401097c-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-44bf6c93-230d-47e8-bc09-76ec1401097c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f20395f8-ab28-4518-bde0-847df892a1aa tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-b02a90a6-ef71-4eda-b964-b8fbf24b5686-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-quobyte-44bf6c93-230d-47e8-bc09-76ec1401097c" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-44bf6c93-230d-47e8-bc09-76ec1401097c" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e362b9-bad2-4145-ae10-fdbec3c0aa30]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:05 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c Jul 10 00:53:05 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:06 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c" returned: 0 in 0.740s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:06 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c Jul 10 00:53:06 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:07 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-44bf6c93-230d-47e8-bc09-76ec1401097c" returned: 0 in 0.658s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-44bf6c93-230d-47e8-bc09-76ec1401097c" released by "delete_volume" :: held 1.437s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Created reservations ['1a950e6a-ef16-42b4-979e-2a7a4577de91', '35732b26-3f46-4e9d-94a8-935736333274', 'a4d8d40e-1f8d-417b-87e3-c541bac902d0', 'fa7fed3b-ff65-4829-96ed-d1917270ba43'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:07 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:53:07 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-fc94f9b9-6527-4078-bcbc-91b6d7a88190-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-fc94f9b9-6527-4078-bcbc-91b6d7a88190-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:07 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.636s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:53:07 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Deleted volume successfully. Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-quobyte-fc94f9b9-6527-4078-bcbc-91b6d7a88190" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8755c51f-b34d-4da3-bc18-64a154c517de tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-44bf6c93-230d-47e8-bc09-76ec1401097c-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-fc94f9b9-6527-4078-bcbc-91b6d7a88190" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f50307-34ab-4db1-b1b9-3bc3069a36d2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:08 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 Jul 10 00:53:08 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:08 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190" returned: 0 in 0.747s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:08 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190 Jul 10 00:53:08 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:09 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fc94f9b9-6527-4078-bcbc-91b6d7a88190" returned: 0 in 0.640s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-fc94f9b9-6527-4078-bcbc-91b6d7a88190" released by "delete_volume" :: held 1.421s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Created reservations ['e841321c-5f3a-452b-8acc-127ae94818e6', '68f161d0-99d5-4118-aa42-3476fa537d7f', 'be874cfe-ac0e-4c7e-92b1-fb496c4349f8', '8cb8de1f-c44f-4dad-9a64-f87ee6c2644b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:09 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:53:09 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:10 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.631s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:53:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Deleted volume successfully. Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-cfaa7988-3d63-483e-a9c4-afda3a9b94fa-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-cfaa7988-3d63-483e-a9c4-afda3a9b94fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0d79008f-cee0-497e-ab7e-e4bc983729ab tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-fc94f9b9-6527-4078-bcbc-91b6d7a88190-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "cinder-quobyte-cfaa7988-3d63-483e-a9c4-afda3a9b94fa" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-cfaa7988-3d63-483e-a9c4-afda3a9b94fa" acquired by "delete_volume" :: waited 0.013s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85dcbde-1b05-4066-bb2d-88f4b05e8687]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:10 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa Jul 10 00:53:10 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:11 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa" returned: 0 in 0.714s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:11 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa Jul 10 00:53:11 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:11 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-cfaa7988-3d63-483e-a9c4-afda3a9b94fa" returned: 0 in 0.626s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-quobyte-cfaa7988-3d63-483e-a9c4-afda3a9b94fa" released by "delete_volume" :: held 1.379s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:11 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Created reservations ['f93d93c4-15b1-4c75-bf32-ff9164a289cc', '13af8c5e-d896-438d-a452-7c4228d3cc94', '3a0e0752-fef1-4bdf-87b6-605a884672af', '8828341c-05d9-4a8d-a92b-0acea5d24d47'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:12 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:53:12 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:12 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.622s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:53:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Deleted volume successfully. Jul 10 00:53:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-7b493c43-3467-4390-9ccf-2e6e2528888f tempest-CreateVolumesFromImageTest-1227766729 None] Lock "cinder-cfaa7988-3d63-483e-a9c4-afda3a9b94fa-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Flow 'volume_create_manager' (0801990f-050c-49ef-a463-2a6869ef56a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80f63a5-99b2-4206-b045-366d2bdcc563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80f63a5-99b2-4206-b045-366d2bdcc563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d528dadc-5336-49a6-882f-f7a635cb1133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb78405263b415abceb5a294d739ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:19Z,use_quota=True,user_id='6d5c7c11e89e41698a1f79c276935c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b98281-a60a-4faa-95f8-f962bdc60577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b98281-a60a-4faa-95f8-f962bdc60577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03171c3d-c3b6-410b-a7df-d92f3c28a0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:18 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03171c3d-c3b6-410b-a7df-d92f3c28a0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd528dadc-5336-49a6-882f-f7a635cb1133', 'volume_name': 'volume-d528dadc-5336-49a6-882f-f7a635cb1133', 'volume_size': 1, 'image_id': '48b1dd28-c85d-4d98-b709-a0d3951bf437', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48b1dd28-c85d-4d98-b709-a0d3951bf437', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e13701ea4c2c01aad8f46792c09dea3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfb78405263b415abceb5a294d739ab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2466b00c4fbffe4ff7f189801ba31edff850cc20fd31dbab1abff6200611633933561216f533d53b5c81ef2d1f020e326f673b16911f799c5eb0aeab8b9ac1c', 'id': '48b1dd28-c85d-4d98-b709-a0d3951bf437', 'created_at': datetime.datetime(2026, 7, 9, 22, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48b1dd28-c85d-4d98-b709-a0d3951bf437/file', 'properties': {}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f0d80a-2fa4-4fd2-9091-74e4c3f7ac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f0d80a-2fa4-4fd2-9091-74e4c3f7ac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cff7ab-804a-45e5-90b0-70d5ca74673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Volume d528dadc-5336-49a6-882f-f7a635cb1133: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d528dadc-5336-49a6-882f-f7a635cb1133', 'volume_size': 1, 'image_id': '48b1dd28-c85d-4d98-b709-a0d3951bf437', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48b1dd28-c85d-4d98-b709-a0d3951bf437', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e13701ea4c2c01aad8f46792c09dea3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfb78405263b415abceb5a294d739ab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2466b00c4fbffe4ff7f189801ba31edff850cc20fd31dbab1abff6200611633933561216f533d53b5c81ef2d1f020e326f673b16911f799c5eb0aeab8b9ac1c', 'id': '48b1dd28-c85d-4d98-b709-a0d3951bf437', 'created_at': datetime.datetime(2026, 7, 9, 22, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48b1dd28-c85d-4d98-b709-a0d3951bf437/file', 'properties': {}}, 'image_service': } Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Trying to clone d528dadc-5336-49a6-882f-f7a635cb1133 from image 48b1dd28-c85d-4d98-b709-a0d3951bf437 at location (None, [{'url': 'file:///opt/stack/data/glance/images/48b1dd28-c85d-4d98-b709-a0d3951bf437', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:53:19 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a9dabe-6577-4578-9564-6ba68d7948ce]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:19 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD Jul 10 00:53:19 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:19 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:20 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD Jul 10 00:53:20 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:20 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD" returned: 1 in 0.719s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:53:20 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Temporary image 48b1dd28-c85d-4d98-b709-a0d3951bf437 is fetched for user 6d5c7c11e89e41698a1f79c276935c97. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:53:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[70911854-09b7-4a96-ad65-22cf47ed1e2a]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:20 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD Jul 10 00:53:20 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:21 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD" returned: 0 in 0.703s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:21 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD Jul 10 00:53:21 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:22 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD" returned: 1 in 0.709s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d528dadc-5336-49a6-882f-f7a635cb1133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb78405263b415abceb5a294d739ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:19Z,use_quota=True,user_id='6d5c7c11e89e41698a1f79c276935c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Creating volume d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:53:22 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:22 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 1073741824 Jul 10 00:53:22 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:22 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 1073741824" returned: 0 in 0.784s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:22 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 Jul 10 00:53:22 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:23 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133" returned: 0 in 0.607s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:53:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:23 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Attempting download of 48b1dd28-c85d-4d98-b709-a0d3951bf437 ((None, [{'url': 'file:///opt/stack/data/glance/images/48b1dd28-c85d-4d98-b709-a0d3951bf437', 'metadata': {}}])) to volume d528dadc-5336-49a6-882f-f7a635cb1133. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:53:23 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[726ec3d5-7ddf-44bf-b448-95f34d871cbb]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48b1dd28-c85d-4d98-b709-a0d3951bf437_qd4c6pr9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:23 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48b1dd28-c85d-4d98-b709-a0d3951bf437_qd4c6pr9 Jul 10 00:53:23 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:24 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48b1dd28-c85d-4d98-b709-a0d3951bf437_qd4c6pr9" returned: 0 in 0.700s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48b1dd28-c85d-4d98-b709-a0d3951bf437_qd4c6pr9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:24 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48b1dd28-c85d-4d98-b709-a0d3951bf437_qd4c6pr9 Jul 10 00:53:24 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:25 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48b1dd28-c85d-4d98-b709-a0d3951bf437_qd4c6pr9" returned: 1 in 0.679s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48b1dd28-c85d-4d98-b709-a0d3951bf437_qd4c6pr9' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:53:25 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beaabd4-120f-4b23-9247-50310b178ed6]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:25 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD Jul 10 00:53:25 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:25 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:25 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD Jul 10 00:53:25 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:26 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD" returned: 1 in 0.679s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:53:26 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] 48b1dd28-c85d-4d98-b709-a0d3951bf437 was raw, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:53:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:26 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 Jul 10 00:53:26 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:27 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133" returned: 0 in 0.706s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:27 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_48b1dd28-c85d-4d98-b709-a0d3951bf437_hn_jbkmhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:53:27 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:53:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:27 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 1G Jul 10 00:53:27 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:27 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 1G" returned: 0 in 0.644s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03c148-e39f-4f28-bf23-e67a8390b4aa]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:27 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 Jul 10 00:53:27 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:28 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133" returned: 0 in 0.705s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:28 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 Jul 10 00:53:28 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:29 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133" returned: 1 in 0.702s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Downloaded image 48b1dd28-c85d-4d98-b709-a0d3951bf437 ((None, [{'url': 'file:///opt/stack/data/glance/images/48b1dd28-c85d-4d98-b709-a0d3951bf437', 'metadata': {}}])) to volume d528dadc-5336-49a6-882f-f7a635cb1133 successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Temporary image 48b1dd28-c85d-4d98-b709-a0d3951bf437 for user 6d5c7c11e89e41698a1f79c276935c97 is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Marking volume d528dadc-5336-49a6-882f-f7a635cb1133 as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Copying metadata from image 48b1dd28-c85d-4d98-b709-a0d3951bf437 to d528dadc-5336-49a6-882f-f7a635cb1133. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Creating volume glance metadata for volume d528dadc-5336-49a6-882f-f7a635cb1133 backed by image 48b1dd28-c85d-4d98-b709-a0d3951bf437 with: {'image_id': '48b1dd28-c85d-4d98-b709-a0d3951bf437', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2e13701ea4c2c01aad8f46792c09dea3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cff7ab-804a-45e5-90b0-70d5ca74673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d528dadc-5336-49a6-882f-f7a635cb1133', 'volume_size': 1, 'image_id': '48b1dd28-c85d-4d98-b709-a0d3951bf437', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48b1dd28-c85d-4d98-b709-a0d3951bf437', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e13701ea4c2c01aad8f46792c09dea3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfb78405263b415abceb5a294d739ab6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2466b00c4fbffe4ff7f189801ba31edff850cc20fd31dbab1abff6200611633933561216f533d53b5c81ef2d1f020e326f673b16911f799c5eb0aeab8b9ac1c', 'id': '48b1dd28-c85d-4d98-b709-a0d3951bf437', 'created_at': datetime.datetime(2026, 7, 9, 22, 53, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 53, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48b1dd28-c85d-4d98-b709-a0d3951bf437/file', 'properties': {}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bf7bd3-5d7d-4cd0-a786-c21c968187c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Volume volume-d528dadc-5336-49a6-882f-f7a635cb1133 (d528dadc-5336-49a6-882f-f7a635cb1133): created successfully Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bf7bd3-5d7d-4cd0-a786-c21c968187c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Flow 'volume_create_manager' (0801990f-050c-49ef-a463-2a6869ef56a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-51710dae-133f-4e2b-a887-b6de320e9bb0 tempest-VolumeImageDependencyTests-1077362058 None] Created volume successfully. Jul 10 00:53:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Acquiring lock "cinder-d528dadc-5336-49a6-882f-f7a635cb1133-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Lock "cinder-d528dadc-5336-49a6-882f-f7a635cb1133-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Acquiring lock "cinder-quobyte-d528dadc-5336-49a6-882f-f7a635cb1133" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:53:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Lock "cinder-quobyte-d528dadc-5336-49a6-882f-f7a635cb1133" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:53:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cba8fa-c0d9-42a0-96a4-f65e4f09fb17]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:30 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 Jul 10 00:53:30 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:31 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133" returned: 0 in 0.729s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:31 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 Jul 10 00:53:31 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:32 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133" returned: 1 in 0.739s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:32 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133 Jul 10 00:53:32 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:32 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d528dadc-5336-49a6-882f-f7a635cb1133" returned: 0 in 0.638s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Lock "cinder-quobyte-d528dadc-5336-49a6-882f-f7a635cb1133" released by "delete_volume" :: held 2.164s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Created reservations ['85893d78-9366-4195-ae99-2ce3eca9ef7b', 'b729c558-b348-4046-84a4-a93d7b52e59b', '7b04128e-4990-4434-9370-b492371b9d6a', 'ea41322a-603a-4cfe-9452-3c5d3f3102d9'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:32 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:53:32 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:33 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.604s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:33 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:53:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Deleted volume successfully. Jul 10 00:53:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-56539549-9f1b-4851-aa1b-c4d95b3531a3 tempest-VolumeImageDependencyTests-1077362058 None] Lock "cinder-d528dadc-5336-49a6-882f-f7a635cb1133-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:53:42 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=49,cinder:UPDATE=63,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:53:43 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=73,cinder:SELECT=47,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:53:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:53:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:53 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:53:53 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (c6539572-27fb-4e17-bcba-e922d8686a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1d9a36-e0e8-42d8-8d05-b97f41723c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1d9a36-e0e8-42d8-8d05-b97f41723c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1352621971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04617f0a-e9f2-4be9-8e32-4b02abce5404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:54Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aab85b-b36d-430c-bb11-8d0e186059c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55aab85b-b36d-430c-bb11-8d0e186059c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640f1e15-0cd0-4bfb-80c4-5eb7cc0d3f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640f1e15-0cd0-4bfb-80c4-5eb7cc0d3f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04617f0a-e9f2-4be9-8e32-4b02abce5404', 'volume_name': 'volume-04617f0a-e9f2-4be9-8e32-4b02abce5404', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe76ccb-7786-4720-9d3a-3cc7c5445763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe76ccb-7786-4720-9d3a-3cc7c5445763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5a872b-24b1-4732-a5a6-1b90690a0951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume 04617f0a-e9f2-4be9-8e32-4b02abce5404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04617f0a-e9f2-4be9-8e32-4b02abce5404', 'volume_size': 1} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1352621971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04617f0a-e9f2-4be9-8e32-4b02abce5404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:54Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Creating volume 04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:53:54 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:54 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 1073741824 Jul 10 00:53:54 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:54 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (bad2946e-3f61-470f-b449-03087211340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ff12d-de41-40a1-a482-2adf9700ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.111s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ff12d-de41-40a1-a482-2adf9700ba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868320847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21cddfd-b8b9-4528-862a-b1cb361d7c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:54Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166296bc-68da-4cec-97a2-fe29d6873e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166296bc-68da-4cec-97a2-fe29d6873e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabbaa56-39c4-4066-97ec-ac6287090472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabbaa56-39c4-4066-97ec-ac6287090472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21cddfd-b8b9-4528-862a-b1cb361d7c48', 'volume_name': 'volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aaf33ef-a8e3-4b4a-918e-179f81dddef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aaf33ef-a8e3-4b4a-918e-179f81dddef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37741a5b-9ae8-4d00-bffe-6682b63397d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Volume a21cddfd-b8b9-4528-862a-b1cb361d7c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48', 'volume_size': 1} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (d1afca6f-42d4-4699-9287-91d147a34563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b38af-eccc-4085-98dc-d8ee678c62c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b38af-eccc-4085-98dc-d8ee678c62c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256001420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d4de59-97d2-4826-8254-345591130169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:55Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9e8e21-5688-4d89-a725-994160a46ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9e8e21-5688-4d89-a725-994160a46ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319b8bf4-fc05-40ea-8a9f-cf0ec6d8fd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319b8bf4-fc05-40ea-8a9f-cf0ec6d8fd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d4de59-97d2-4826-8254-345591130169', 'volume_name': 'volume-b2d4de59-97d2-4826-8254-345591130169', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e6d75-6dd3-46b4-bc61-356402ccc453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e6d75-6dd3-46b4-bc61-356402ccc453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c809bc1c-99b1-44c2-bfd4-da2d4c564cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Volume b2d4de59-97d2-4826-8254-345591130169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d4de59-97d2-4826-8254-345591130169', 'volume_size': 1} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Flow 'volume_create_manager' (f4e11368-46b2-4c9c-b5c7-3ac0035859e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c38e1e-8302-4c6d-8f74-8ca9eee98376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c38e1e-8302-4c6d-8f74-8ca9eee98376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac87318-f7b1-4506-8cf0-12ba99767cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426dbf45dce3466790bbe362fa751472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:55Z,use_quota=True,user_id='e141329f07064e79a57ddc774e13eda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fd1a2e-b7c0-401b-9581-6c335cfa8249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fd1a2e-b7c0-401b-9581-6c335cfa8249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc9856d-59c6-4f5d-916a-a8f933281f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc9856d-59c6-4f5d-916a-a8f933281f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac87318-f7b1-4506-8cf0-12ba99767cb4', 'volume_name': 'volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1cd7dd-cddc-42fa-bf62-96b34cf162ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1cd7dd-cddc-42fa-bf62-96b34cf162ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59295e79-2c76-49c6-9b8f-cf5f0f16070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Volume 5ac87318-f7b1-4506-8cf0-12ba99767cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4', 'volume_size': 1} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (bacf4687-5cc2-4b5a-9447-723a78715833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5d49f8-90d4-44e1-a0e9-a455762f2c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5d49f8-90d4-44e1-a0e9-a455762f2c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-961569877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271323a8-0fa8-4d55-b402-93260357c49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:55Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f2a11-ea7f-4fb4-bca5-cae2e2af64d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f2a11-ea7f-4fb4-bca5-cae2e2af64d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1717ffd5-515e-431e-99f1-39e35fa40c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1717ffd5-515e-431e-99f1-39e35fa40c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271323a8-0fa8-4d55-b402-93260357c49b', 'volume_name': 'volume-271323a8-0fa8-4d55-b402-93260357c49b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a29f3-f91b-42fd-8ada-5ba77591f9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a29f3-f91b-42fd-8ada-5ba77591f9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b14cdb-7adb-46f4-bc1c-cce34902e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Volume 271323a8-0fa8-4d55-b402-93260357c49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271323a8-0fa8-4d55-b402-93260357c49b', 'volume_size': 1} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:55 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 1073741824" returned: 0 in 1.194s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:55 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 Jul 10 00:53:55 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (5d450576-e554-4960-b81c-5798db16c482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305d3a9a-e150-440d-b187-5f61eab3e2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:55 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305d3a9a-e150-440d-b187-5f61eab3e2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-727130988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78789f55-eecf-4acb-95e6-f4b872437322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:56Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9f6b62-89ec-4b88-b74e-a98432958201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9f6b62-89ec-4b88-b74e-a98432958201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bb89ea-c521-4d43-bd60-d8db556da878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bb89ea-c521-4d43-bd60-d8db556da878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78789f55-eecf-4acb-95e6-f4b872437322', 'volume_name': 'volume-78789f55-eecf-4acb-95e6-f4b872437322', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af368aeb-5bab-4a6d-bf21-ad8ea35302c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af368aeb-5bab-4a6d-bf21-ad8ea35302c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd15b1e4-f723-46c3-ba11-f6ad3464541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Volume 78789f55-eecf-4acb-95e6-f4b872437322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78789f55-eecf-4acb-95e6-f4b872437322', 'volume_size': 1} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (427f07dc-3f60-4714-920d-f032090bd88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4898ad6b-640e-4349-b5e6-b6728eba037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4898ad6b-640e-4349-b5e6-b6728eba037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826321642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bceddab2-e2f9-4984-a5dc-1477e3099b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:56Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0921179-bd86-46cc-99f0-a047121a6aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0921179-bd86-46cc-99f0-a047121a6aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0e62fe-5f10-441c-928f-9def2cbf3c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0e62fe-5f10-441c-928f-9def2cbf3c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bceddab2-e2f9-4984-a5dc-1477e3099b57', 'volume_name': 'volume-bceddab2-e2f9-4984-a5dc-1477e3099b57', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe01ba14-a623-4c8b-ab6e-d861119fdd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe01ba14-a623-4c8b-ab6e-d861119fdd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcae456-5177-4b49-9a59-b3d87dfd866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Volume bceddab2-e2f9-4984-a5dc-1477e3099b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bceddab2-e2f9-4984-a5dc-1477e3099b57', 'volume_size': 1} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:56 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404" returned: 0 in 0.867s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868320847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21cddfd-b8b9-4528-862a-b1cb361d7c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:54Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Creating volume a21cddfd-b8b9-4528-862a-b1cb361d7c48 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:53:56 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5a872b-24b1-4732-a5a6-1b90690a0951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04617f0a-e9f2-4be9-8e32-4b02abce5404', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 1073741824 Jul 10 00:53:56 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d13f192-213a-405d-9336-60837a90429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 (04617f0a-e9f2-4be9-8e32-4b02abce5404): created successfully Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d13f192-213a-405d-9336-60837a90429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (c6539572-27fb-4e17-bcba-e922d8686a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c0b0794f-b764-44f3-bf8c-6d045f567d95 tempest-CreateVolumesFromSnapshotTest-929644231 None] Created volume successfully. Jul 10 00:53:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:57 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 1073741824" returned: 0 in 0.988s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:57 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 Jul 10 00:53:57 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Flow 'volume_create_manager' (d332bbf5-c550-4c97-8419-2c574d1d1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:58 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adf0869-8d80-4b11-abbb-7d95ee6a97f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48" returned: 0 in 0.766s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.452s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256001420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d4de59-97d2-4826-8254-345591130169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:55Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Creating volume b2d4de59-97d2-4826-8254-345591130169 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:53:58 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adf0869-8d80-4b11-abbb-7d95ee6a97f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9842979-7d0a-406d-bf01-a91387c364ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b0dd7567934e3192b3f5c25ab212b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:58Z,use_quota=True,user_id='9976a8b72b284496937838ab2a27cbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5530442e-ef4d-4df3-ac8b-1b12a4ca7312),volume_type_id=5530442e-ef4d-4df3-ac8b-1b12a4ca7312)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:58 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 1073741824 Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88775a2f-c7f4-403e-9f6d-ed8c516d7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:58 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88775a2f-c7f4-403e-9f6d-ed8c516d7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f6e9a0-2329-4214-8bc8-b0b281c405a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37741a5b-9ae8-4d00-bffe-6682b63397d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57554fc-3ff8-4e97-bf2f-34fd6b6dcda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Volume volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 (a21cddfd-b8b9-4528-862a-b1cb361d7c48): created successfully Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57554fc-3ff8-4e97-bf2f-34fd6b6dcda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (bad2946e-3f61-470f-b449-03087211340a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:53:58 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-026aff1e-9363-4115-ab3a-58e1ed32e4cc tempest-CreateVolumesFromImageTest-791638074 None] Created volume successfully. Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f6e9a0-2329-4214-8bc8-b0b281c405a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9842979-7d0a-406d-bf01-a91387c364ec', 'volume_name': 'volume-c9842979-7d0a-406d-bf01-a91387c364ec', 'volume_size': 1, 'image_id': 'f055f8b2-e3b8-4cb2-830e-1b4785996836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f055f8b2-e3b8-4cb2-830e-1b4785996836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7639d4b44399c652f53d0572bba5518', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90b0dd7567934e3192b3f5c25ab212b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3658409e6ae5c70b2368c22531a1b71aac5dfcbe8a544ed9ecd9cfc79cdfd43f3fc15bde7b86542b9fa5478eeef67386ab3194fc3ea834e6d9c2ecf26240ef1d', 'id': 'f055f8b2-e3b8-4cb2-830e-1b4785996836', 'created_at': datetime.datetime(2026, 7, 9, 22, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f055f8b2-e3b8-4cb2-830e-1b4785996836/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d12d97b-59a0-4c51-a8f7-d81832fed00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d12d97b-59a0-4c51-a8f7-d81832fed00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29af86e-927c-4373-95d5-c3ec442c3c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:53:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Volume c9842979-7d0a-406d-bf01-a91387c364ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9842979-7d0a-406d-bf01-a91387c364ec', 'volume_size': 1, 'image_id': 'f055f8b2-e3b8-4cb2-830e-1b4785996836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f055f8b2-e3b8-4cb2-830e-1b4785996836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7639d4b44399c652f53d0572bba5518', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90b0dd7567934e3192b3f5c25ab212b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3658409e6ae5c70b2368c22531a1b71aac5dfcbe8a544ed9ecd9cfc79cdfd43f3fc15bde7b86542b9fa5478eeef67386ab3194fc3ea834e6d9c2ecf26240ef1d', 'id': 'f055f8b2-e3b8-4cb2-830e-1b4785996836', 'created_at': datetime.datetime(2026, 7, 9, 22, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f055f8b2-e3b8-4cb2-830e-1b4785996836/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Trying to clone c9842979-7d0a-406d-bf01-a91387c364ec from image f055f8b2-e3b8-4cb2-830e-1b4785996836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f055f8b2-e3b8-4cb2-830e-1b4785996836', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:53:58 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da851c7-f6e8-4731-afc3-e041facd67dd]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:53:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:59 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD Jul 10 00:53:59 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:59 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 1073741824" returned: 0 in 0.847s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:59 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 Jul 10 00:53:59 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:53:59 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 10 00:53:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:53:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:53:59 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD Jul 10 00:53:59 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:00 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169" returned: 0 in 0.635s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.851s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac87318-f7b1-4506-8cf0-12ba99767cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426dbf45dce3466790bbe362fa751472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:55Z,use_quota=True,user_id='e141329f07064e79a57ddc774e13eda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Creating volume 5ac87318-f7b1-4506-8cf0-12ba99767cb4 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:00 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:00 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 1073741824 Jul 10 00:54:00 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c809bc1c-99b1-44c2-bfd4-da2d4c564cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d4de59-97d2-4826-8254-345591130169', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668ce312-0de2-4e16-977f-ddb0b701d50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:00 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Volume volume-b2d4de59-97d2-4826-8254-345591130169 (b2d4de59-97d2-4826-8254-345591130169): created successfully Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668ce312-0de2-4e16-977f-ddb0b701d50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (d1afca6f-42d4-4699-9287-91d147a34563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-56aee7f5-b077-4039-bab0-6abcf1f8d12d tempest-CreateVolumesFromImageTest-791638074 None] Created volume successfully. Jul 10 00:54:00 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD" returned: 1 in 0.715s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Temporary image f055f8b2-e3b8-4cb2-830e-1b4785996836 is fetched for user 9976a8b72b284496937838ab2a27cbba. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67ecf2b-87d7-4947-9dfc-b7c8082fd5b3]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:00 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD Jul 10 00:54:00 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:00 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 1073741824" returned: 0 in 0.868s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:01 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 Jul 10 00:54:01 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:01 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:01 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD Jul 10 00:54:01 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:01 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4" returned: 0 in 0.702s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.166s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-961569877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271323a8-0fa8-4d55-b402-93260357c49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:55Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Creating volume 271323a8-0fa8-4d55-b402-93260357c49b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:01 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:01 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b 1073741824 Jul 10 00:54:01 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59295e79-2c76-49c6-9b8f-cf5f0f16070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f7456b-3bec-4646-b25b-2afce866ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:01 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Volume volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 (5ac87318-f7b1-4506-8cf0-12ba99767cb4): created successfully Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f7456b-3bec-4646-b25b-2afce866ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Flow 'volume_create_manager' (f4e11368-46b2-4c9c-b5c7-3ac0035859e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:01 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ca44fcdc-999b-49d3-ac6f-ee85f129922b tempest-CinderUnicodeTest-10417172 None] Created volume successfully. Jul 10 00:54:02 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD" returned: 1 in 0.755s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:54:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:02 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b 1073741824" returned: 0 in 0.841s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:02 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b Jul 10 00:54:02 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:02 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Flow 'volume_create_manager' (377b8aa7-9ce3-4787-99d5-096ea3b4dae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd21686-5ec2-4783-b20a-ebaf841c6224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd21686-5ec2-4783-b20a-ebaf841c6224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1020326740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bb168b-385c-47c7-be1b-ed381cb8c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426dbf45dce3466790bbe362fa751472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:03Z,use_quota=True,user_id='e141329f07064e79a57ddc774e13eda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7e44da-6bfa-4a8e-90a4-ca914c5c6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7e44da-6bfa-4a8e-90a4-ca914c5c6074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed46115-87ca-404b-a0d5-bc33e000a208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed46115-87ca-404b-a0d5-bc33e000a208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65bb168b-385c-47c7-be1b-ed381cb8c166', 'volume_name': 'volume-65bb168b-385c-47c7-be1b-ed381cb8c166', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33b4f47-8cce-4e0f-a698-a4ee1f04d835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33b4f47-8cce-4e0f-a698-a4ee1f04d835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e11244-c88a-43dc-adee-84ada92617eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Volume 65bb168b-385c-47c7-be1b-ed381cb8c166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65bb168b-385c-47c7-be1b-ed381cb8c166', 'volume_size': 1} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:03 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b" returned: 0 in 0.697s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.246s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-727130988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78789f55-eecf-4acb-95e6-f4b872437322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:56Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Creating volume 78789f55-eecf-4acb-95e6-f4b872437322 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:03 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b14cdb-7adb-46f4-bc1c-cce34902e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271323a8-0fa8-4d55-b402-93260357c49b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:03 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 1073741824 Jul 10 00:54:03 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dbcb5f-dfcf-461f-8ad1-66c652066c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Volume volume-271323a8-0fa8-4d55-b402-93260357c49b (271323a8-0fa8-4d55-b402-93260357c49b): created successfully Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dbcb5f-dfcf-461f-8ad1-66c652066c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (bacf4687-5cc2-4b5a-9447-723a78715833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ce1fdeda-fe5b-45ed-b657-451661915f73 tempest-CreateVolumesFromImageTest-791638074 None] Created volume successfully. Jul 10 00:54:04 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 1073741824" returned: 0 in 0.824s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:04 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 Jul 10 00:54:04 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:04 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322" returned: 0 in 0.655s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.407s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826321642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bceddab2-e2f9-4984-a5dc-1477e3099b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01b4e81ddfa4d56ac540fa21410cda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:56Z,use_quota=True,user_id='86b6a4a2da6f4ea8b2187cdec8a6d061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Creating volume bceddab2-e2f9-4984-a5dc-1477e3099b57 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:04 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:04 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 1073741824 Jul 10 00:54:04 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd15b1e4-f723-46c3-ba11-f6ad3464541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78789f55-eecf-4acb-95e6-f4b872437322', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1521a9bf-4143-4205-81e4-e835d5d8a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:04 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Volume volume-78789f55-eecf-4acb-95e6-f4b872437322 (78789f55-eecf-4acb-95e6-f4b872437322): created successfully Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1521a9bf-4143-4205-81e4-e835d5d8a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:04 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (5d450576-e554-4960-b81c-5798db16c482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f9bc6e91-0e7c-4f87-be6c-4a039178a3fd tempest-CreateVolumesFromImageTest-791638074 None] Created volume successfully. Jul 10 00:54:05 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 1073741824" returned: 0 in 0.836s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:05 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 Jul 10 00:54:05 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:06 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57" returned: 0 in 0.631s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.756s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcae456-5177-4b49-9a59-b3d87dfd866d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bceddab2-e2f9-4984-a5dc-1477e3099b57', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ca8c3b-8105-4150-87d5-d456af68ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Creating offline snapshot 7c2b2173-71dd-4047-9260-592c087e2a36 of volume 04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:54:06 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Volume volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 (bceddab2-e2f9-4984-a5dc-1477e3099b57): created successfully Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ca8c3b-8105-4150-87d5-d456af68ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Flow 'volume_create_manager' (427f07dc-3f60-4714-920d-f032090bd88d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb8eab2-4d8b-459a-b51f-88c1a073477a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c03223e6-667f-41a6-b208-5815e4509124 tempest-CreateVolumesFromImageTest-791638074 None] Created volume successfully. Jul 10 00:54:06 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 Jul 10 00:54:06 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:07 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404" returned: 0 in 0.784s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:07 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 1G Jul 10 00:54:07 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-bceddab2-e2f9-4984-a5dc-1477e3099b57-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-bceddab2-e2f9-4984-a5dc-1477e3099b57-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-quobyte-bceddab2-e2f9-4984-a5dc-1477e3099b57" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-bceddab2-e2f9-4984-a5dc-1477e3099b57" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[34be1e2c-b1e0-42a4-a38b-a4a798e66bb4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:07 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 Jul 10 00:54:07 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:07 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 1G" returned: 0 in 0.832s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:08 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 Jul 10 00:54:08 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:08 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57" returned: 0 in 0.876s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:08 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57 Jul 10 00:54:08 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:08 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36" returned: 0 in 0.741s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:08 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 is being set with open permissions: ugo+rw Jul 10 00:54:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:08 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 Jul 10 00:54:08 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:08 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-bceddab2-e2f9-4984-a5dc-1477e3099b57" returned: 0 in 0.645s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-bceddab2-e2f9-4984-a5dc-1477e3099b57" released by "delete_volume" :: held 1.566s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Created reservations ['acf2e6f5-7ad1-4270-9972-414cd224409d', '3291b7a9-0dec-4ddd-9922-0f65a3f45909', '9abf3c98-3b14-4271-8522-89c2f7445fac', '3e1c8197-8a82-41d7-bd5b-789b389ddbdf'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:09 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:09 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:09 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36" returned: 0 in 0.681s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:09 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.info Jul 10 00:54:09 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-78789f55-eecf-4acb-95e6-f4b872437322-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-78789f55-eecf-4acb-95e6-f4b872437322-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-quobyte-78789f55-eecf-4acb-95e6-f4b872437322" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-78789f55-eecf-4acb-95e6-f4b872437322" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fce128-713c-4b09-9a88-107ac6c55b37]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:09 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.680s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Deleted volume successfully. Jul 10 00:54:09 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 Jul 10 00:54:09 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ca022db1-b4a3-4b8c-8152-40c8c2527a0f tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-bceddab2-e2f9-4984-a5dc-1477e3099b57-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:10 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.info" returned: 0 in 0.731s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:10 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.info is being set with open permissions: ugo+rw Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:10 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.info Jul 10 00:54:10 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:10 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322" returned: 0 in 0.750s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:10 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322 Jul 10 00:54:10 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:10 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.info" returned: 0 in 0.692s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.827s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9842979-7d0a-406d-bf01-a91387c364ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b0dd7567934e3192b3f5c25ab212b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:53:58Z,use_quota=True,user_id='9976a8b72b284496937838ab2a27cbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5530442e-ef4d-4df3-ac8b-1b12a4ca7312),volume_type_id=5530442e-ef4d-4df3-ac8b-1b12a4ca7312)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Creating volume c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:10 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:10 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec 1073741824 Jul 10 00:54:10 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-63ebafe5-c9be-43c2-89ff-2eff00f11cd5 tempest-CreateVolumesFromSnapshotTest-929644231 None] Create snapshot completed successfully Jul 10 00:54:11 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-78789f55-eecf-4acb-95e6-f4b872437322" returned: 0 in 0.693s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-78789f55-eecf-4acb-95e6-f4b872437322" released by "delete_volume" :: held 1.507s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Created reservations ['ee3f1824-0650-4ef4-85b4-4c8c64a0ccca', 'a985dd08-56d1-484f-86de-0e5c6255326d', '5efc3882-2d08-4f4e-8f7d-b5deebba5c5e', '52cafcc7-f8dc-43c0-aae0-0e2033fc2c25'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:11 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:11 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (4b8eda9e-0b92-4946-9d9f-281b71a04910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e223225-02a3-4508-9a35-176f892a3cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e223225-02a3-4508-9a35-176f892a3cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-356612979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83eb4e5-6476-4814-b3a8-3bcadcb19996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:12Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910cc125-83fd-421b-b46b-151841a4c861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910cc125-83fd-421b-b46b-151841a4c861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8846be0-13e8-443a-804a-6a9e0ae259fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8846be0-13e8-443a-804a-6a9e0ae259fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83eb4e5-6476-4814-b3a8-3bcadcb19996', 'volume_name': 'volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e11436e-0e87-4d03-9047-19c728a9b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e11436e-0e87-4d03-9047-19c728a9b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40231cf-a8a7-4726-b463-6241976b9163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:11 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume d83eb4e5-6476-4814-b3a8-3bcadcb19996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996', 'volume_size': 1} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-271323a8-0fa8-4d55-b402-93260357c49b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-271323a8-0fa8-4d55-b402-93260357c49b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-quobyte-271323a8-0fa8-4d55-b402-93260357c49b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-271323a8-0fa8-4d55-b402-93260357c49b" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:12 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.756s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Deleted volume successfully. Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c038ba5-dc94-4ecd-9134-fe5f9ce51f99]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f7d65e0e-82b3-4de9-8478-1be8282c51e8 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-78789f55-eecf-4acb-95e6-f4b872437322-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:12 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (d2b75418-35d1-43e3-93f9-e10e3ac627f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad29ad7-e4da-4a66-8514-2d0240ef145d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec 1073741824" returned: 0 in 1.280s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad29ad7-e4da-4a66-8514-2d0240ef145d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665795328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a44792-1a0f-4ac4-a3ed-b5d8096c5300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:12Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb23fa1a-3d85-4227-8de6-8d3770725703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb23fa1a-3d85-4227-8de6-8d3770725703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6b84e5-d8b4-4ff2-b3fa-7f67a7306912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6b84e5-d8b4-4ff2-b3fa-7f67a7306912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a44792-1a0f-4ac4-a3ed-b5d8096c5300', 'volume_name': 'volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd35090d-b4d2-4c30-80fe-4ef7597a9c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd35090d-b4d2-4c30-80fe-4ef7597a9c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7a921a-ad82-40b8-891b-e2fa949e68d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume b6a44792-1a0f-4ac4-a3ed-b5d8096c5300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300', 'volume_size': 1} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:12 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b Jul 10 00:54:12 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:12 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec Jul 10 00:54:12 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (ece22b59-85a9-4a49-941d-1aaf7237e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f00807-4034-4cb1-86a5-acd954b2a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f00807-4034-4cb1-86a5-acd954b2a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449420943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5479ed07-d403-4049-bbdc-dca7eeaad14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:12Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a53d67-f72e-4da9-bc50-04c4d360f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a53d67-f72e-4da9-bc50-04c4d360f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfe21e8-1135-4c69-86c1-472b9872fa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfe21e8-1135-4c69-86c1-472b9872fa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5479ed07-d403-4049-bbdc-dca7eeaad14b', 'volume_name': 'volume-5479ed07-d403-4049-bbdc-dca7eeaad14b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e872880d-539b-4b78-ad9b-b26a0313fea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e872880d-539b-4b78-ad9b-b26a0313fea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726eabe9-272a-4e0e-8c04-8ca7f99b0e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume 5479ed07-d403-4049-bbdc-dca7eeaad14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5479ed07-d403-4049-bbdc-dca7eeaad14b', 'volume_size': 1} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (96072fb3-7097-4def-927d-4e2a813d1f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901606d8-703a-4934-9da1-eae60d13499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901606d8-703a-4934-9da1-eae60d13499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638661614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5985f8-4c49-4100-bf9b-7cfa8f75ca17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:13Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400cc909-5d5e-42c5-96a0-dadfd213660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400cc909-5d5e-42c5-96a0-dadfd213660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef7840-c544-4f3a-ba54-f80bf47e7759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef7840-c544-4f3a-ba54-f80bf47e7759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5985f8-4c49-4100-bf9b-7cfa8f75ca17', 'volume_name': 'volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45cfd42f-de69-4ad3-af8d-a674f4012568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45cfd42f-de69-4ad3-af8d-a674f4012568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd402543-53ad-4142-8844-91882aaa1ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume eb5985f8-4c49-4100-bf9b-7cfa8f75ca17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17', 'volume_size': 1} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:13 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b" returned: 0 in 0.992s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:13 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b Jul 10 00:54:13 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:13 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec" returned: 0 in 0.887s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.115s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1020326740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bb168b-385c-47c7-be1b-ed381cb8c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426dbf45dce3466790bbe362fa751472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:03Z,use_quota=True,user_id='e141329f07064e79a57ddc774e13eda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Creating volume 65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:13 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:13 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 1073741824 Jul 10 00:54:13 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Attempting download of f055f8b2-e3b8-4cb2-830e-1b4785996836 ((None, [{'url': 'file:///opt/stack/data/glance/images/f055f8b2-e3b8-4cb2-830e-1b4785996836', 'metadata': {}}])) to volume c9842979-7d0a-406d-bf01-a91387c364ec. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (28e97dd1-69b2-4e90-98c5-1ceaa0ba9e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8ff91b-6fbd-4b7b-95c7-fc61d916c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87a34e4-03a5-494f-b7d5-fe1685d88884]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f055f8b2-e3b8-4cb2-830e-1b4785996836_t4_mn1t8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8ff91b-6fbd-4b7b-95c7-fc61d916c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153283570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fba517-1ba9-4add-86a7-b4da646f96a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:13Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075a481d-7e6f-4cc2-b657-fc74853533c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (075a481d-7e6f-4cc2-b657-fc74853533c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243da73f-bb35-454d-9d3b-7db9b2e1183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243da73f-bb35-454d-9d3b-7db9b2e1183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4fba517-1ba9-4add-86a7-b4da646f96a9', 'volume_name': 'volume-b4fba517-1ba9-4add-86a7-b4da646f96a9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7df6708-6ef5-4312-a802-53dfcad7d054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7df6708-6ef5-4312-a802-53dfcad7d054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aec987-3cd0-4cff-a184-1d186936ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:13 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume b4fba517-1ba9-4add-86a7-b4da646f96a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4fba517-1ba9-4add-86a7-b4da646f96a9', 'volume_size': 1} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:13 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f055f8b2-e3b8-4cb2-830e-1b4785996836_t4_mn1t8 Jul 10 00:54:13 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:13 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-271323a8-0fa8-4d55-b402-93260357c49b" returned: 0 in 0.729s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-271323a8-0fa8-4d55-b402-93260357c49b" released by "delete_volume" :: held 1.794s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Created reservations ['5633b7a2-6322-4fb6-9895-7ceb52d9258c', 'ccb2d223-84c3-46c8-897d-f1e129a69692', 'b6bf4f49-b264-4ccc-b7a7-4211d12cb46f', '4d66a723-c48b-4fe9-946a-7d3ba56b2a73'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:14 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:14 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:14 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 1073741824" returned: 0 in 1.036s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-b2d4de59-97d2-4826-8254-345591130169-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-b2d4de59-97d2-4826-8254-345591130169-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:14 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f055f8b2-e3b8-4cb2-830e-1b4785996836_t4_mn1t8" returned: 0 in 0.975s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f055f8b2-e3b8-4cb2-830e-1b4785996836_t4_mn1t8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:14 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 Jul 10 00:54:14 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-quobyte-b2d4de59-97d2-4826-8254-345591130169" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-b2d4de59-97d2-4826-8254-345591130169" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[97889a34-c196-4081-bd25-c67b474ca2f2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:14 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f055f8b2-e3b8-4cb2-830e-1b4785996836_t4_mn1t8 Jul 10 00:54:14 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:14 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 Jul 10 00:54:14 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:14 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:14 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Deleted volume successfully. Jul 10 00:54:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a048ca95-b307-43cf-88a0-b208b3b29637 tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-271323a8-0fa8-4d55-b402-93260357c49b-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:15 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166" returned: 0 in 0.741s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.226s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-356612979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83eb4e5-6476-4814-b3a8-3bcadcb19996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:12Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Creating volume d83eb4e5-6476-4814-b3a8-3bcadcb19996 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:15 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:15 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 1073741824 Jul 10 00:54:15 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e11244-c88a-43dc-adee-84ada92617eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bb168b-385c-47c7-be1b-ed381cb8c166', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd8d57f-b0a4-4a3c-a10d-c4d4bcd65da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:15 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Volume volume-65bb168b-385c-47c7-be1b-ed381cb8c166 (65bb168b-385c-47c7-be1b-ed381cb8c166): created successfully Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd8d57f-b0a4-4a3c-a10d-c4d4bcd65da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Flow 'volume_create_manager' (377b8aa7-9ce3-4787-99d5-096ea3b4dae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:15 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f055f8b2-e3b8-4cb2-830e-1b4785996836_t4_mn1t8" returned: 1 in 0.831s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f055f8b2-e3b8-4cb2-830e-1b4785996836_t4_mn1t8' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3a08c7-0848-43cb-aec4-92fb6471b3b5]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:15 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4b4b648e-bf20-492a-ac2d-1b97b9a1a0fe tempest-CinderUnicodeTest-10417172 None] Created volume successfully. Jul 10 00:54:15 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD Jul 10 00:54:15 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:15 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169" returned: 0 in 0.949s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:15 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169 Jul 10 00:54:15 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:16 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:16 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 1073741824" returned: 0 in 0.938s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:16 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b2d4de59-97d2-4826-8254-345591130169" returned: 0 in 0.643s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-b2d4de59-97d2-4826-8254-345591130169" released by "delete_volume" :: held 1.651s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:16 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD Jul 10 00:54:16 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:16 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 Jul 10 00:54:16 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Created reservations ['53d87f0d-75f6-438a-a3cb-cdb6ca02421e', '2e8480fc-6d02-4d0c-a1d9-ac2af709adc6', 'c905403d-c622-4424-bb59-f54736999ab1', '5583c1a8-56fa-4d30-abf6-77ad5753b696'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:16 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:16 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-a21cddfd-b8b9-4528-862a-b1cb361d7c48-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-a21cddfd-b8b9-4528-862a-b1cb361d7c48-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "cinder-quobyte-a21cddfd-b8b9-4528-862a-b1cb361d7c48" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-a21cddfd-b8b9-4528-862a-b1cb361d7c48" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3891f0-a0e6-410f-b7e8-586c972b7d6b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:17 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996" returned: 0 in 0.941s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.791s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665795328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a44792-1a0f-4ac4-a3ed-b5d8096c5300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:12Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Creating volume b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:17 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:17 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:17 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 1073741824 Jul 10 00:54:17 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 Jul 10 00:54:17 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40231cf-a8a7-4726-b463-6241976b9163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:17 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f07b879-babd-4f51-b562-bf82bbffd22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD" returned: 1 in 1.133s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] f055f8b2-e3b8-4cb2-830e-1b4785996836 was raw, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:17 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 (d83eb4e5-6476-4814-b3a8-3bcadcb19996): created successfully Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f07b879-babd-4f51-b562-bf82bbffd22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (4b8eda9e-0b92-4946-9d9f-281b71a04910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:17 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec Jul 10 00:54:17 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1ee44c36-76f7-43aa-a2c7-e1813ec5cd2f tempest-CreateVolumesFromSnapshotTest-929644231 None] Created volume successfully. Jul 10 00:54:17 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.006s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Deleted volume successfully. Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-8975825e-02b8-4774-8b44-e929f58b841c tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-b2d4de59-97d2-4826-8254-345591130169-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:17 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48" returned: 0 in 1.011s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:17 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48 Jul 10 00:54:17 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:17 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec" returned: 0 in 0.835s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f055f8b2-e3b8-4cb2-830e-1b4785996836_vs8921widevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:54:17 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:54:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:18 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec 1G Jul 10 00:54:18 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:18 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 1073741824" returned: 0 in 1.018s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:18 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 Jul 10 00:54:18 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:18 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-a21cddfd-b8b9-4528-862a-b1cb361d7c48" returned: 0 in 0.651s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-quobyte-a21cddfd-b8b9-4528-862a-b1cb361d7c48" released by "delete_volume" :: held 1.733s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Created reservations ['2663b6c7-d6cc-40c8-bc75-5c7eaf6d0430', '11891980-d60b-4d2c-8fcc-de6cdd47f8f7', '1d0c36dd-34af-4411-8155-c2dbb3d50bc0', '9fb250e0-72ea-4498-a054-673c7a3537f7'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:18 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec 1G" returned: 0 in 0.742s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:18 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:18 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[092b82af-4c82-4d75-8f36-73b8022435d9]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:18 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300" returned: 0 in 0.766s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:18 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec Jul 10 00:54:18 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.271s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449420943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5479ed07-d403-4049-bbdc-dca7eeaad14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:12Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Creating volume 5479ed07-d403-4049-bbdc-dca7eeaad14b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:18 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:18 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b 1073741824 Jul 10 00:54:18 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7a921a-ad82-40b8-891b-e2fa949e68d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:18 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a1654d-c36c-4dad-9ee6-b78e2d1c5584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 (b6a44792-1a0f-4ac4-a3ed-b5d8096c5300): created successfully Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a1654d-c36c-4dad-9ee6-b78e2d1c5584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (d2b75418-35d1-43e3-93f9-e10e3ac627f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-16dcef76-8fcb-4bfa-98d0-3df69ed5102c tempest-CreateVolumesFromSnapshotTest-929644231 None] Created volume successfully. Jul 10 00:54:19 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.758s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Deleted volume successfully. Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6cd57e7-f54b-4b2b-a851-45492d442edb tempest-CreateVolumesFromImageTest-791638074 None] Lock "cinder-a21cddfd-b8b9-4528-862a-b1cb361d7c48-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:19 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec" returned: 0 in 0.986s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:19 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec Jul 10 00:54:19 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:19 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b 1073741824" returned: 0 in 1.001s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:20 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b Jul 10 00:54:20 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:20 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b" returned: 0 in 0.730s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.694s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638661614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5985f8-4c49-4100-bf9b-7cfa8f75ca17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:13Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Creating volume eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:20 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:20 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 1073741824 Jul 10 00:54:20 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726eabe9-272a-4e0e-8c04-8ca7f99b0e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5479ed07-d403-4049-bbdc-dca7eeaad14b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:20 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b3dc8d-dd07-4cd7-91f0-c23bb4a1aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec" returned: 1 in 0.999s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Downloaded image f055f8b2-e3b8-4cb2-830e-1b4785996836 ((None, [{'url': 'file:///opt/stack/data/glance/images/f055f8b2-e3b8-4cb2-830e-1b4785996836', 'metadata': {}}])) to volume c9842979-7d0a-406d-bf01-a91387c364ec successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Temporary image f055f8b2-e3b8-4cb2-830e-1b4785996836 for user 9976a8b72b284496937838ab2a27cbba is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Marking volume c9842979-7d0a-406d-bf01-a91387c364ec as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:54:20 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume volume-5479ed07-d403-4049-bbdc-dca7eeaad14b (5479ed07-d403-4049-bbdc-dca7eeaad14b): created successfully Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b3dc8d-dd07-4cd7-91f0-c23bb4a1aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (ece22b59-85a9-4a49-941d-1aaf7237e157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Copying metadata from image f055f8b2-e3b8-4cb2-830e-1b4785996836 to c9842979-7d0a-406d-bf01-a91387c364ec. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Creating volume glance metadata for volume c9842979-7d0a-406d-bf01-a91387c364ec backed by image f055f8b2-e3b8-4cb2-830e-1b4785996836 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f055f8b2-e3b8-4cb2-830e-1b4785996836', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a7639d4b44399c652f53d0572bba5518', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:54:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7bf59391-42e3-4ae9-874a-36eb89f470b1 tempest-CreateVolumesFromSnapshotTest-929644231 None] Created volume successfully. Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29af86e-927c-4373-95d5-c3ec442c3c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9842979-7d0a-406d-bf01-a91387c364ec', 'volume_size': 1, 'image_id': 'f055f8b2-e3b8-4cb2-830e-1b4785996836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f055f8b2-e3b8-4cb2-830e-1b4785996836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a7639d4b44399c652f53d0572bba5518', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90b0dd7567934e3192b3f5c25ab212b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3658409e6ae5c70b2368c22531a1b71aac5dfcbe8a544ed9ecd9cfc79cdfd43f3fc15bde7b86542b9fa5478eeef67386ab3194fc3ea834e6d9c2ecf26240ef1d', 'id': 'f055f8b2-e3b8-4cb2-830e-1b4785996836', 'created_at': datetime.datetime(2026, 7, 9, 22, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f055f8b2-e3b8-4cb2-830e-1b4785996836/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0dfd4a-04d8-4ab3-9747-4aca9cc07ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:20 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Volume volume-c9842979-7d0a-406d-bf01-a91387c364ec (c9842979-7d0a-406d-bf01-a91387c364ec): created successfully Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0dfd4a-04d8-4ab3-9747-4aca9cc07ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:20 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Flow 'volume_create_manager' (d332bbf5-c550-4c97-8419-2c574d1d1ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-14f9aef3-9a25-4571-9151-daa2cd738991 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Created volume successfully. Jul 10 00:54:21 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 1073741824" returned: 0 in 1.033s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:21 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 Jul 10 00:54:21 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Acquiring lock "cinder-c9842979-7d0a-406d-bf01-a91387c364ec-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "cinder-c9842979-7d0a-406d-bf01-a91387c364ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Acquiring lock "cinder-quobyte-c9842979-7d0a-406d-bf01-a91387c364ec" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "cinder-quobyte-c9842979-7d0a-406d-bf01-a91387c364ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc8f66-7175-4672-9fc3-355432937d12]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:22 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec Jul 10 00:54:22 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:22 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17" returned: 0 in 0.648s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.974s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153283570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fba517-1ba9-4add-86a7-b4da646f96a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84bdeb41ea647a59920881bb008de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:13Z,use_quota=True,user_id='ecb6bf95660d4a6fb3e77e07a1237c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Creating volume b4fba517-1ba9-4add-86a7-b4da646f96a9 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:22 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd402543-53ad-4142-8844-91882aaa1ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a673f9-6149-4b6c-807f-45db11efbdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:22 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 1073741824 Jul 10 00:54:22 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:22 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 (eb5985f8-4c49-4100-bf9b-7cfa8f75ca17): created successfully Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a673f9-6149-4b6c-807f-45db11efbdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (96072fb3-7097-4def-927d-4e2a813d1f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:22 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-854aa0b2-db88-42ec-bcd0-877f3473872b tempest-CreateVolumesFromSnapshotTest-929644231 None] Created volume successfully. Jul 10 00:54:23 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec" returned: 0 in 0.804s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:23 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec Jul 10 00:54:23 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:23 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 1073741824" returned: 0 in 0.895s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:23 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 Jul 10 00:54:23 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:23 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec" returned: 1 in 0.792s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:54:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:23 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec Jul 10 00:54:23 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:24 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9" returned: 0 in 0.685s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.494s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Creating offline snapshot 53de7c1a-309b-4026-9d63-24343c79d4b1 of volume 65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc78eeba-a5b3-4771-9b9f-d20b2b120b96]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aec987-3cd0-4cff-a184-1d186936ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4fba517-1ba9-4add-86a7-b4da646f96a9', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5731c9-ccfc-42b5-a591-aaa86ebc534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:24 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Volume volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 (b4fba517-1ba9-4add-86a7-b4da646f96a9): created successfully Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5731c9-ccfc-42b5-a591-aaa86ebc534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Flow 'volume_create_manager' (28e97dd1-69b2-4e90-98c5-1ceaa0ba9e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:24 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2b27aac0-fff4-4f7c-947d-0715daccfa0f tempest-CreateVolumesFromSnapshotTest-929644231 None] Created volume successfully. Jul 10 00:54:24 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 Jul 10 00:54:24 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-b4fba517-1ba9-4add-86a7-b4da646f96a9-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-b4fba517-1ba9-4add-86a7-b4da646f96a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-b4fba517-1ba9-4add-86a7-b4da646f96a9" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-b4fba517-1ba9-4add-86a7-b4da646f96a9" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a8bfd3-4efb-4f72-ac22-2561bceac089]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:24 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 Jul 10 00:54:24 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:24 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9842979-7d0a-406d-bf01-a91387c364ec" returned: 0 in 0.888s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "cinder-quobyte-c9842979-7d0a-406d-bf01-a91387c364ec" released by "delete_volume" :: held 2.570s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Created reservations ['70d2fae8-d7e8-4f9b-8196-f28966a0784e', 'f6a878f5-8469-444b-9006-aebd712c5a64', '6ce5ca56-eb8a-440a-98dd-17cdab6a6782', '3600b0da-5753-4f4c-beee-0b69fca3cdc5'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:25 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:25 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:25 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166" returned: 0 in 0.954s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:25 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 1G Jul 10 00:54:25 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:25 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9" returned: 0 in 0.984s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:25 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9 Jul 10 00:54:25 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:25 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.913s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:25 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Deleted volume successfully. Jul 10 00:54:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-152c3e37-bb14-45a3-8aff-2f089d6602b1 tempest-VolumeAndVolumeTypeFromImageTest-1999285081 None] Lock "cinder-c9842979-7d0a-406d-bf01-a91387c364ec-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:26 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 1G" returned: 0 in 1.137s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65bb168b-385c-47c7-be1b-ed381cb8c166 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:26 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65bb168b-385c-47c7-be1b-ed381cb8c166 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 Jul 10 00:54:26 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:26 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b4fba517-1ba9-4add-86a7-b4da646f96a9" returned: 0 in 0.981s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-b4fba517-1ba9-4add-86a7-b4da646f96a9" released by "delete_volume" :: held 2.031s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Created reservations ['d36fa759-59da-4cbd-85df-559817e9cb9f', '9c97d40d-ef60-4e06-9186-8b1780758dfb', '140b7a7f-e43d-4ea9-b456-5e9dd7389da0', '59bc8700-3f6f-4477-9e77-6931b55d004d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:26 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:26 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d92375-1b4f-40bc-896f-526b5d0937e3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:27 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 Jul 10 00:54:27 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:27 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65bb168b-385c-47c7-be1b-ed381cb8c166 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1" returned: 0 in 0.888s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:27 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 is being set with open permissions: ugo+rw Jul 10 00:54:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:27 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 Jul 10 00:54:27 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:27 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.000s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:27 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Deleted volume successfully. Jul 10 00:54:27 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4ce9df65-3afc-49d3-9f5f-b2966912f6cf tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-b4fba517-1ba9-4add-86a7-b4da646f96a9-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:28 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17" returned: 0 in 1.156s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:28 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1" returned: 0 in 1.033s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:28 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17 Jul 10 00:54:28 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:28 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.info Jul 10 00:54:28 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:28 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17" returned: 0 in 0.785s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17" released by "delete_volume" :: held 1.993s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Created reservations ['f299569b-b5f3-4426-9504-e4b70c82c30e', 'c9fe4f85-fee9-4a11-b790-352986038bc4', '9cc4dc98-e8d9-48ad-b664-b483226365aa', '03d43213-0f9e-4108-b22c-9b5e4af1945b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:29 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.info" returned: 0 in 0.936s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:29 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.info is being set with open permissions: ugo+rw Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:29 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:29 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:29 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.info Jul 10 00:54:29 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-5479ed07-d403-4049-bbdc-dca7eeaad14b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-5479ed07-d403-4049-bbdc-dca7eeaad14b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-5479ed07-d403-4049-bbdc-dca7eeaad14b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-5479ed07-d403-4049-bbdc-dca7eeaad14b" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf731dbf-ccbd-427f-a79f-d95745a9e81f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:29 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b Jul 10 00:54:29 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (0708e17d-32d9-480c-be19-b61d995b58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c975a8d-fe38-4e95-ade8-513775728022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c975a8d-fe38-4e95-ade8-513775728022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102120455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f81953-1714-4eb5-a82c-22885edc0f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:30Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2648469b-e1e1-4059-8c76-c205a61609f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2648469b-e1e1-4059-8c76-c205a61609f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1286627-bb9b-4a26-a1aa-92764bfca6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1286627-bb9b-4a26-a1aa-92764bfca6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f81953-1714-4eb5-a82c-22885edc0f2a', 'volume_name': 'volume-84f81953-1714-4eb5-a82c-22885edc0f2a', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eed952-e8d2-4c3b-82a9-9df2b276cada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eed952-e8d2-4c3b-82a9-9df2b276cada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97602a03-a5bb-435e-826a-38c9c132cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Volume 84f81953-1714-4eb5-a82c-22885edc0f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f81953-1714-4eb5-a82c-22885edc0f2a', 'volume_size': 1} Jul 10 00:54:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:30 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Deleted volume successfully. Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-262ac6f5-7ed0-4bd9-a06b-dfced79359cd tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-eb5985f8-4c49-4100-bf9b-7cfa8f75ca17-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:30 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.info" returned: 0 in 1.172s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.237s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2102120455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f81953-1714-4eb5-a82c-22885edc0f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:30Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Creating volume 84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:30 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:30 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a 1073741824 Jul 10 00:54:30 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-dfbc42d9-aecc-4dbc-a53b-946db057be97 tempest-CinderUnicodeTest-10417172 None] Create snapshot completed successfully Jul 10 00:54:30 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b" returned: 0 in 0.899s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:30 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b Jul 10 00:54:30 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:31 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5479ed07-d403-4049-bbdc-dca7eeaad14b" returned: 0 in 0.672s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-5479ed07-d403-4049-bbdc-dca7eeaad14b" released by "delete_volume" :: held 1.669s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Created reservations ['865e8f08-e028-4f7e-9e29-9d4c136f5aa2', 'a36ad0a0-ce49-4afc-bc5c-8ea75f294ea0', '43c1d4ba-98d0-450b-bd5a-95b6ddd09dda', '52f4de97-7619-4f9b-8211-ee61d0ca5fdd'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Acquiring lock "cinder-53de7c1a-309b-4026-9d63-24343c79d4b1-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Lock "cinder-53de7c1a-309b-4026-9d63-24343c79d4b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Acquiring lock "cinder-quobyte-65bb168b-385c-47c7-be1b-ed381cb8c166" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:31 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:31 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-65bb168b-385c-47c7-be1b-ed381cb8c166" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Acquiring lock "cinder-quobyte-53de7c1a-309b-4026-9d63-24343c79d4b1" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:31 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Flow 'volume_create_manager' (84d81415-e9b8-469b-94e8-16a90e3eec70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035fc77f-54fc-48b6-8d2c-edd85570aaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a 1073741824" returned: 0 in 1.152s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-53de7c1a-309b-4026-9d63-24343c79d4b1" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Deleting offline snapshot 53de7c1a-309b-4026-9d63-24343c79d4b1 of volume 65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] snapshot_file for this snap is: volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035fc77f-54fc-48b6-8d2c-edd85570aaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-926588629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d50ca0-9ecb-495f-a7ad-8faeb59889da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403d6fee3e64bd884e1802b08331be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:31Z,use_quota=True,user_id='1675d87352694abc82ffaaea4aceefa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ceba9-5aa2-46b5-aea6-5439ce5fd46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ceba9-5aa2-46b5-aea6-5439ce5fd46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3a468a-bc8f-48ee-8031-7ecd80b5d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3a468a-bc8f-48ee-8031-7ecd80b5d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d50ca0-9ecb-495f-a7ad-8faeb59889da', 'volume_name': 'volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c2cf02-33d9-4f52-981b-e93323c7bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c2cf02-33d9-4f52-981b-e93323c7bafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a632f85-56bd-463c-bdfc-f333be070736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:31 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Volume 10d50ca0-9ecb-495f-a7ad-8faeb59889da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da', 'volume_size': 1} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f424019f-f1b3-4936-a922-8a0308f976bf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:31 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a Jul 10 00:54:31 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:31 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 Jul 10 00:54:31 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff77e8ac-d282-4b64-a0ac-5f6ea729fd99]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:31 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 Jul 10 00:54:31 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:32 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.729s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Deleted volume successfully. Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-bdcd7c82-e77c-4a53-af09-4cae16fa496f tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-5479ed07-d403-4049-bbdc-dca7eeaad14b-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:32 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a" returned: 0 in 0.774s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:32 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-926588629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d50ca0-9ecb-495f-a7ad-8faeb59889da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403d6fee3e64bd884e1802b08331be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:31Z,use_quota=True,user_id='1675d87352694abc82ffaaea4aceefa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Creating volume 10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:32 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1" returned: 0 in 0.897s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65bb168b-385c-47c7-be1b-ed381cb8c166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97602a03-a5bb-435e-826a-38c9c132cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f81953-1714-4eb5-a82c-22885edc0f2a', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:32 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da 1073741824 Jul 10 00:54:32 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2628e9-be94-43a8-9604-2692be038f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ac16e-7dd7-4aab-9499-539416beedd5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:32 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Volume volume-84f81953-1714-4eb5-a82c-22885edc0f2a (84f81953-1714-4eb5-a82c-22885edc0f2a): created successfully Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2628e9-be94-43a8-9604-2692be038f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (0708e17d-32d9-480c-be19-b61d995b58ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-89456fdb-db42-4699-a3b5-1dbdc8e11e1c tempest-ProjectReaderTests-1003598966 None] Created volume successfully. Jul 10 00:54:32 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 Jul 10 00:54:32 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:32 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300" returned: 0 in 0.880s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:32 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300 Jul 10 00:54:32 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:33 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166" returned: 0 in 0.881s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:33 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da 1073741824" returned: 0 in 0.963s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:33 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 Jul 10 00:54:33 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:33 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300" returned: 0 in 0.819s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:33 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da Jul 10 00:54:33 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300" released by "delete_volume" :: held 1.760s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Created reservations ['bad96546-584c-44e3-99cc-352a2ad7391f', '03281aed-5b72-4550-8a8a-27e055efb9c7', 'fed8e323-45b1-4590-9991-6e03f61f53a6', '44c95ddd-b873-434a-87a6-f17e5d5f354e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:33 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:33 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-d83eb4e5-6476-4814-b3a8-3bcadcb19996-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-d83eb4e5-6476-4814-b3a8-3bcadcb19996-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-d83eb4e5-6476-4814-b3a8-3bcadcb19996" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-d83eb4e5-6476-4814-b3a8-3bcadcb19996" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f3392a-41ef-4eb5-8a75-74d74f9988ad]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:34 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 Jul 10 00:54:34 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:34 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da" returned: 0 in 0.860s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.262s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Creating offline snapshot f594043a-9327-4b86-ae21-22e468140d89 of volume 84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:54:34 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1" returned: 0 in 0.970s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:34 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282e5ec-1c71-4421-971d-11b156d6976c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:34 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1 Jul 10 00:54:34 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a632f85-56bd-463c-bdfc-f333be070736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6750ae72-eda6-4e83-8de5-ea485875fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.802s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Deleted volume successfully. Jul 10 00:54:34 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Volume volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da (10d50ca0-9ecb-495f-a7ad-8faeb59889da): created successfully Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6750ae72-eda6-4e83-8de5-ea485875fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Flow 'volume_create_manager' (84d81415-e9b8-469b-94e8-16a90e3eec70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2aed7709-a177-42e3-bf24-601e58a10bbf tempest-VolumeDependencyTests-416871117 None] Created volume successfully. Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2661f525-36eb-44a2-8bb9-f707c5c2575d tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-b6a44792-1a0f-4ac4-a3ed-b5d8096c5300-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:34 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a Jul 10 00:54:34 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:34 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996" returned: 0 in 0.905s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:34 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996 Jul 10 00:54:34 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:35 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166.53de7c1a-309b-4026-9d63-24343c79d4b1" returned: 0 in 0.899s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:35 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a" returned: 0 in 0.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-53de7c1a-309b-4026-9d63-24343c79d4b1" released by "_delete_snapshot" :: held 3.843s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-65bb168b-385c-47c7-be1b-ed381cb8c166" released by "delete_snapshot" :: held 3.917s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:35 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 1G Jul 10 00:54:35 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Created reservations ['b674cd35-6dd0-4df0-8d42-9a6c1cf7b490', 'dbfe07e6-f5fd-4abc-ab0b-ad404f7fce97', '168c7870-a882-4bb0-8a42-2e4e25d8aa2d', '381c9cba-639e-4c6d-bc3c-7e1ad0c7083a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Delete snapshot completed successfully. Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3da0047-45d8-4864-84c3-628d9516c96c tempest-CinderUnicodeTest-10417172 None] Lock "cinder-53de7c1a-309b-4026-9d63-24343c79d4b1-delete_snapshot" released by "delete_snapshot" :: held 4.100s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Acquiring lock "cinder-65bb168b-385c-47c7-be1b-ed381cb8c166-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-65bb168b-385c-47c7-be1b-ed381cb8c166-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:35 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d83eb4e5-6476-4814-b3a8-3bcadcb19996" returned: 0 in 0.759s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-d83eb4e5-6476-4814-b3a8-3bcadcb19996" released by "delete_volume" :: held 1.730s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Acquiring lock "cinder-quobyte-65bb168b-385c-47c7-be1b-ed381cb8c166" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-65bb168b-385c-47c7-be1b-ed381cb8c166" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[735c80c4-2302-4ae1-b665-bbb0a0c6ca45]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Created reservations ['da345285-40de-4d04-9808-9bf907a6a097', '229910ba-6cc1-448e-9929-9c02482606dc', 'be1cf1ba-a6db-4fd5-bfdf-dd202f70e287', '9814d25d-821b-45cc-b42f-9d309380cfd2'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:35 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:35 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:35 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 Jul 10 00:54:35 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-7c2b2173-71dd-4047-9260-592c087e2a36-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-7c2b2173-71dd-4047-9260-592c087e2a36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-04617f0a-e9f2-4be9-8e32-4b02abce5404" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-04617f0a-e9f2-4be9-8e32-4b02abce5404" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-7c2b2173-71dd-4047-9260-592c087e2a36" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-7c2b2173-71dd-4047-9260-592c087e2a36" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Deleting offline snapshot 7c2b2173-71dd-4047-9260-592c087e2a36 of volume 04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] snapshot_file for this snap is: volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c481e08-ed9e-424e-b1a6-080be91a386b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:36 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 1G" returned: 0 in 0.964s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f81953-1714-4eb5-a82c-22885edc0f2a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:36 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 Jul 10 00:54:36 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f81953-1714-4eb5-a82c-22885edc0f2a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 Jul 10 00:54:36 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:36 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:36 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.722s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:36 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Deleted volume successfully. Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f24d2fc1-dbd9-4cf5-bff5-430cc41c7e33 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-d83eb4e5-6476-4814-b3a8-3bcadcb19996-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:36 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166" returned: 0 in 0.954s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:36 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166 Jul 10 00:54:36 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:37 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f81953-1714-4eb5-a82c-22885edc0f2a -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:37 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 is being set with open permissions: ugo+rw Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:37 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 Jul 10 00:54:37 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:37 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36" returned: 0 in 0.875s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04617f0a-e9f2-4be9-8e32-4b02abce5404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[54350cad-5fb4-4c2e-b9f5-75486dc70237]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:37 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 Jul 10 00:54:37 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:37 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-65bb168b-385c-47c7-be1b-ed381cb8c166" returned: 0 in 0.674s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-65bb168b-385c-47c7-be1b-ed381cb8c166" released by "delete_volume" :: held 1.698s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Created reservations ['69b645ca-f42b-44c2-b5ca-0d2a21e237d2', '4d4cffc1-476d-4157-8090-e52a4b2ee0d9', '5cfeba2d-38f8-4415-b703-85d86024a228', '1f0ce968-2d6f-4247-9e5a-f7c064cb602d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:37 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:37 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:37 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89" returned: 0 in 0.774s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:37 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.info Jul 10 00:54:37 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Acquiring lock "cinder-5ac87318-f7b1-4506-8cf0-12ba99767cb4-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-5ac87318-f7b1-4506-8cf0-12ba99767cb4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Acquiring lock "cinder-quobyte-5ac87318-f7b1-4506-8cf0-12ba99767cb4" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-5ac87318-f7b1-4506-8cf0-12ba99767cb4" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:38 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404" returned: 0 in 0.912s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9ad154-b19d-4138-bd34-0c776fda2f1f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:38 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 Jul 10 00:54:38 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:38 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 Jul 10 00:54:38 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:38 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.757s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:38 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Deleted volume successfully. Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d3cffbee-64e0-4f40-890f-d756abf0c4d0 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-65bb168b-385c-47c7-be1b-ed381cb8c166-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:38 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.info" returned: 0 in 0.853s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:38 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.info is being set with open permissions: ugo+rw Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:38 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.info Jul 10 00:54:38 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:38 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36" returned: 0 in 0.781s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:38 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36 Jul 10 00:54:38 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:38 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4" returned: 0 in 0.890s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:38 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4 Jul 10 00:54:38 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:39 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.info" returned: 0 in 0.657s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.039s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.506s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Creating offline snapshot 5dabb8f0-3815-43dc-ae7d-83031f46f659 of volume 10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df3faf-6bb1-46e6-9fec-017463b111d7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:39 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7f2295d8-139a-4dc5-995e-caa1b753d0aa tempest-ProjectReaderTests-1003598966 None] Create snapshot completed successfully Jul 10 00:54:39 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404.7c2b2173-71dd-4047-9260-592c087e2a36" returned: 0 in 0.690s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-7c2b2173-71dd-4047-9260-592c087e2a36" released by "_delete_snapshot" :: held 3.391s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-04617f0a-e9f2-4be9-8e32-4b02abce5404" released by "delete_snapshot" :: held 3.419s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:39 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da Jul 10 00:54:39 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Created reservations ['b9b9d725-bddb-4680-b77c-80fc73fecd5e', '21ad0552-88d2-4c92-8e18-a3bc15c44af3', 'd84dda9e-8239-4c5b-967b-a23fd82a770a', 'a674cd45-ae38-47ca-836c-6b894c24faf0'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:39 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Delete snapshot completed successfully. Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5621a2d3-2f56-4c00-91dc-b54fe299aeef tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-7c2b2173-71dd-4047-9260-592c087e2a36-delete_snapshot" released by "delete_snapshot" :: held 3.565s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:39 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-5ac87318-f7b1-4506-8cf0-12ba99767cb4" returned: 0 in 0.770s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-quobyte-5ac87318-f7b1-4506-8cf0-12ba99767cb4" released by "delete_volume" :: held 1.721s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Created reservations ['2eb0f81b-f218-47d8-842f-de147cbf22b2', '4e0d131f-4b45-435b-b809-cb20cbf88471', '7fdf8bd4-5242-4362-b66b-e2cb245c5bb0', '94643dd3-0452-48f5-bb88-753b83c134d8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:39 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:39 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:40 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da" returned: 0 in 0.800s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:40 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 1G Jul 10 00:54:40 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-04617f0a-e9f2-4be9-8e32-4b02abce5404-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-04617f0a-e9f2-4be9-8e32-4b02abce5404-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "cinder-quobyte-04617f0a-e9f2-4be9-8e32-4b02abce5404" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-04617f0a-e9f2-4be9-8e32-4b02abce5404" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a20a74-d446-4194-a018-003d8d7760b8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:40 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.944s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:40 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 Jul 10 00:54:40 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-f594043a-9327-4b86-ae21-22e468140d89-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Deleted volume successfully. Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-f594043a-9327-4b86-ae21-22e468140d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-84f81953-1714-4eb5-a82c-22885edc0f2a" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2e1e6fce-5083-43f0-b598-60f8172071b3 tempest-CinderUnicodeTest-10417172 None] Lock "cinder-5ac87318-f7b1-4506-8cf0-12ba99767cb4-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-84f81953-1714-4eb5-a82c-22885edc0f2a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-f594043a-9327-4b86-ae21-22e468140d89" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-f594043a-9327-4b86-ae21-22e468140d89" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Deleting offline snapshot f594043a-9327-4b86-ae21-22e468140d89 of volume 84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] snapshot_file for this snap is: volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c6794-ca86-4b28-9d60-2b70cf60b21d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:41 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 Jul 10 00:54:41 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:41 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 1G" returned: 0 in 1.189s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:41 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 Jul 10 00:54:41 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:41 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404" returned: 0 in 1.074s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:41 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404 Jul 10 00:54:41 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:42 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89" returned: 0 in 1.015s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84f81953-1714-4eb5-a82c-22885edc0f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dade2ae-343c-4a84-a24a-f65c67a65ac1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:42 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a Jul 10 00:54:42 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:42 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659" returned: 0 in 0.953s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:42 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 is being set with open permissions: ugo+rw Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:42 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 Jul 10 00:54:42 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:42 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-04617f0a-e9f2-4be9-8e32-4b02abce5404" returned: 0 in 0.802s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-quobyte-04617f0a-e9f2-4be9-8e32-4b02abce5404" released by "delete_volume" :: held 1.960s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Created reservations ['ef5a0f5d-9f9e-4b2c-84c1-978e7b0908bd', 'bacf4c79-0c98-4d1f-8194-367c6369a111', 'b6dddd18-810a-429c-9906-fb537bcfb5e3', 'cb37aca7-8c55-4ef9-a161-11a53ad8b04f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:42 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:42 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:43 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a" returned: 0 in 1.079s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:43 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 Jul 10 00:54:43 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:43 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659" returned: 0 in 0.984s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:43 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.info Jul 10 00:54:43 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:43 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.798s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:43 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:43 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Deleted volume successfully. Jul 10 00:54:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-f04f4516-e264-4824-8761-55ce1b121287 tempest-CreateVolumesFromSnapshotTest-929644231 None] Lock "cinder-04617f0a-e9f2-4be9-8e32-4b02abce5404-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:44 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89" returned: 0 in 1.058s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:44 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89 Jul 10 00:54:44 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:44 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.info" returned: 0 in 0.895s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:44 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.info is being set with open permissions: ugo+rw Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:44 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.info Jul 10 00:54:44 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (b55240b5-d722-4944-8eec-3e33bab40d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffb9579-3e76-4ce6-a205-a4c20cee3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffb9579-3e76-4ce6-a205-a4c20cee3f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414983622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d444e59-d59f-4840-815c-3866e57aad1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:45Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d9e254-cf8d-4513-a820-34382ce6533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d9e254-cf8d-4513-a820-34382ce6533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:44 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4841b2-e111-4b76-b923-d5f0e465d743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4841b2-e111-4b76-b923-d5f0e465d743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d444e59-d59f-4840-815c-3866e57aad1e', 'volume_name': 'volume-3d444e59-d59f-4840-815c-3866e57aad1e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d675b7-062e-42f9-94c9-8ef6ba5fc50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d675b7-062e-42f9-94c9-8ef6ba5fc50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6faab63-7077-430a-bc84-d946266f6613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Volume 3d444e59-d59f-4840-815c-3866e57aad1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d444e59-d59f-4840-815c-3866e57aad1e', 'volume_size': 1} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a.f594043a-9327-4b86-ae21-22e468140d89" returned: 0 in 0.826s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-f594043a-9327-4b86-ae21-22e468140d89" released by "_delete_snapshot" :: held 4.106s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-84f81953-1714-4eb5-a82c-22885edc0f2a" released by "delete_snapshot" :: held 4.130s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:45 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.info" returned: 0 in 0.760s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.709s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414983622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d444e59-d59f-4840-815c-3866e57aad1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:45Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Creating volume 3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:45 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:45 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e 1073741824 Jul 10 00:54:45 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Created reservations ['df8a4cd5-28df-4a26-9557-478ecabe2792', '617f5580-0677-4bda-b0c2-305d3b4966b9', '772b67ae-dc19-4025-8228-e4640d6a88fb', '4d92fcca-e30c-45b4-af5e-a8742f22c730'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-352a1721-480b-4741-b97d-5bb2c606c625 tempest-VolumeDependencyTests-416871117 None] Create snapshot completed successfully Jul 10 00:54:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Delete snapshot completed successfully. Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6c40427a-336d-4b71-b3d8-b638a52a2ff5 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-f594043a-9327-4b86-ae21-22e468140d89-delete_snapshot" released by "delete_snapshot" :: held 4.367s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:45 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Flow 'volume_create_manager' (11b92b5f-5e11-468e-85fb-991e1b4a7fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63ac2f4-8520-4cee-9598-f1529135a384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63ac2f4-8520-4cee-9598-f1529135a384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-620620108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52966dc6-c8b1-4303-8baf-37a72671af63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403d6fee3e64bd884e1802b08331be0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5dabb8f0-3815-43dc-ae7d-83031f46f659,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:46Z,use_quota=True,user_id='1675d87352694abc82ffaaea4aceefa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aaae57-1a56-415b-91e3-f05b50fe6b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aaae57-1a56-415b-91e3-f05b50fe6b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522e0294-667d-4b5f-b5ce-a7cc5ffd9fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522e0294-667d-4b5f-b5ce-a7cc5ffd9fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52966dc6-c8b1-4303-8baf-37a72671af63', 'volume_name': 'volume-52966dc6-c8b1-4303-8baf-37a72671af63', 'volume_size': 1, 'snapshot_id': '5dabb8f0-3815-43dc-ae7d-83031f46f659'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91db062c-f59b-488a-aa52-bb5533d9ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91db062c-f59b-488a-aa52-bb5533d9ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27286771-cd0f-4ba2-9145-f3d34c02f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Volume 52966dc6-c8b1-4303-8baf-37a72671af63: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52966dc6-c8b1-4303-8baf-37a72671af63', 'volume_size': 1, 'snapshot_id': '5dabb8f0-3815-43dc-ae7d-83031f46f659'} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:46 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e 1073741824" returned: 0 in 0.990s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:46 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e Jul 10 00:54:46 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-84f81953-1714-4eb5-a82c-22885edc0f2a-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-84f81953-1714-4eb5-a82c-22885edc0f2a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-84f81953-1714-4eb5-a82c-22885edc0f2a" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-84f81953-1714-4eb5-a82c-22885edc0f2a" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba5421-87d1-46e8-993e-cdd252c7b0e2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (b38ffab7-af1b-42c3-9584-34f360db66b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c93aa9-676b-46f2-a9ee-593a448161fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c93aa9-676b-46f2-a9ee-593a448161fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-238325330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fef76da-17c6-4dba-9901-bdd7cf6bd1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:46Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb83464-ae79-4e34-af42-2ab2d89e6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb83464-ae79-4e34-af42-2ab2d89e6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143060bb-2d94-4faf-a28b-97b00d0dc93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143060bb-2d94-4faf-a28b-97b00d0dc93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fef76da-17c6-4dba-9901-bdd7cf6bd1cf', 'volume_name': 'volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0087aa14-0d90-49a7-968c-44b995d38d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0087aa14-0d90-49a7-968c-44b995d38d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332e4422-9534-4369-bd67-bdad180e7d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume 4fef76da-17c6-4dba-9901-bdd7cf6bd1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf', 'volume_size': 1} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:46 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a Jul 10 00:54:46 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:46 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e" returned: 0 in 0.667s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.741s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-quobyte-5dabb8f0-3815-43dc-ae7d-83031f46f659-52966dc6-c8b1-4303-8baf-37a72671af63" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6faab63-7077-430a-bc84-d946266f6613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d444e59-d59f-4840-815c-3866e57aad1e', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3149b8e-0f9f-4df4-8a26-1873070596fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-5dabb8f0-3815-43dc-ae7d-83031f46f659-52966dc6-c8b1-4303-8baf-37a72671af63" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Creating volume 52966dc6-c8b1-4303-8baf-37a72671af63 from snapshot 5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-quobyte-52966dc6-c8b1-4303-8baf-37a72671af63" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:46 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Volume volume-3d444e59-d59f-4840-815c-3866e57aad1e (3d444e59-d59f-4840-815c-3866e57aad1e): created successfully Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3149b8e-0f9f-4df4-8a26-1873070596fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (b55240b5-d722-4944-8eec-3e33bab40d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-52966dc6-c8b1-4303-8baf-37a72671af63" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] snapshot: 5dabb8f0-3815-43dc-ae7d-83031f46f659, volume: 52966dc6-c8b1-4303-8baf-37a72671af63, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:54:46 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b792961e-63fa-44ed-a1a2-57d6d0cb18e8 tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf00c61-ec65-471f-8bd1-af5b3ee8b133]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:47 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 Jul 10 00:54:47 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:47 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a" returned: 0 in 0.778s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:47 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a Jul 10 00:54:47 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:47 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659" returned: 0 in 0.759s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f11046-12fe-447a-836a-1c8c1e9686f7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:47 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-84f81953-1714-4eb5-a82c-22885edc0f2a" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-84f81953-1714-4eb5-a82c-22885edc0f2a" released by "delete_volume" :: held 1.561s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:47 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da Jul 10 00:54:47 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Created reservations ['15f9e85a-c722-4719-83c2-2e5f16afe67f', '70b38f0a-b3af-4885-b62c-583fa9c53f94', '2d629c70-8d99-40a8-9551-57d9457d0deb', '0a225530-b85f-47e6-b502-3c16c0b7da69'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:48 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:48 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:48 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da" returned: 0 in 0.818s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:48 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.647s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Deleted volume successfully. Jul 10 00:54:48 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 Jul 10 00:54:48 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-2816d335-0a4e-47f0-acbf-6f33e8db0dbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-84f81953-1714-4eb5-a82c-22885edc0f2a-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (425c09f0-c769-4a19-b81c-5d3dff16fb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b2b0d4-dee1-47c6-986d-88929a894a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b2b0d4-dee1-47c6-986d-88929a894a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79523544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020498c1-c302-47e8-ab70-4c475a19e266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:49Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5482de68-4d7a-4908-88f3-9d6ef9682c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5482de68-4d7a-4908-88f3-9d6ef9682c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f87c07-c0f0-4218-90aa-45a117fe266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f87c07-c0f0-4218-90aa-45a117fe266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '020498c1-c302-47e8-ab70-4c475a19e266', 'volume_name': 'volume-020498c1-c302-47e8-ab70-4c475a19e266', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83edfffb-9b5c-4ba9-a9dd-5edebd97ea5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83edfffb-9b5c-4ba9-a9dd-5edebd97ea5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d211ae-e3db-494f-8bad-f584012830b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:49 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Volume 020498c1-c302-47e8-ab70-4c475a19e266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-020498c1-c302-47e8-ab70-4c475a19e266', 'volume_size': 1} Jul 10 00:54:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:53 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63" returned: 0 in 4.652s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91c810-c413-49b5-88b6-3083fd7ba65e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:53 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da Jul 10 00:54:53 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:53 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:54:53 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:54 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da" returned: 0 in 0.920s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:54:54 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Converted 1024.00 MB image at 220.07 MB/s Jul 10 00:54:54 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 is being set with open permissions: ugo+rw Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:54 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 Jul 10 00:54:54 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:54 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.630s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:54:54 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63" returned: 0 in 0.620s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-52966dc6-c8b1-4303-8baf-37a72671af63" released by "_copy_volume_from_snapshot" :: held 7.884s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-5dabb8f0-3815-43dc-ae7d-83031f46f659-52966dc6-c8b1-4303-8baf-37a72671af63" released by "_create_volume_from_snapshot" :: held 7.943s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.985s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.382s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-238325330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fef76da-17c6-4dba-9901-bdd7cf6bd1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:46Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Creating volume 4fef76da-17c6-4dba-9901-bdd7cf6bd1cf {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:54:54 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=202,cinder:SELECT=135,cinder:INSERT=54,cinder:DELETE=18 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:54:54 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf 1073741824 Jul 10 00:54:54 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=162,cinder:UPDATE=193,cinder:DELETE=18,cinder:INSERT=49 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27286771-cd0f-4ba2-9145-f3d34c02f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52966dc6-c8b1-4303-8baf-37a72671af63', 'volume_size': 1, 'snapshot_id': '5dabb8f0-3815-43dc-ae7d-83031f46f659'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5480abd-458f-43c2-a85b-ab654aaff3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Volume volume-52966dc6-c8b1-4303-8baf-37a72671af63 (52966dc6-c8b1-4303-8baf-37a72671af63): created successfully Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5480abd-458f-43c2-a85b-ab654aaff3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Flow 'volume_create_manager' (11b92b5f-5e11-468e-85fb-991e1b4a7fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:54 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-88a8194c-e3a5-4242-804a-3da33247a193 tempest-VolumeDependencyTests-416871117 None] Created volume successfully. Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-5dabb8f0-3815-43dc-ae7d-83031f46f659-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-5dabb8f0-3815-43dc-ae7d-83031f46f659-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-quobyte-10d50ca0-9ecb-495f-a7ad-8faeb59889da" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:55 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf 1073741824" returned: 0 in 0.873s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-10d50ca0-9ecb-495f-a7ad-8faeb59889da" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-quobyte-5dabb8f0-3815-43dc-ae7d-83031f46f659" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-5dabb8f0-3815-43dc-ae7d-83031f46f659" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Deleting offline snapshot 5dabb8f0-3815-43dc-ae7d-83031f46f659 of volume 10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] snapshot_file for this snap is: volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a975ea87-6e88-4306-bf90-7fcc9e96b0fb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:55 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf Jul 10 00:54:55 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:55 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 Jul 10 00:54:55 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:56 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf" returned: 0 in 0.634s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.998s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332e4422-9534-4369-bd67-bdad180e7d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ca6215-aca2-4a59-a09c-40b1e19c00c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Creating offline snapshot fe88284d-e5c0-4066-9bd8-776a7462d638 of volume 3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:54:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf (4fef76da-17c6-4dba-9901-bdd7cf6bd1cf): created successfully Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ca6215-aca2-4a59-a09c-40b1e19c00c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (b38ffab7-af1b-42c3-9584-34f360db66b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d334fda0-8ea6-4279-a710-691322bb90b9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-25d77422-4fa3-41f3-b988-e1fe879d6461 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created volume successfully. Jul 10 00:54:56 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659" returned: 0 in 0.778s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a680dc-8b83-4db9-88d0-890f4e7a8e95]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:54:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:56 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e Jul 10 00:54:56 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:56 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da Jul 10 00:54:56 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:57 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e" returned: 0 in 0.801s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:57 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 1G Jul 10 00:54:57 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:57 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da" returned: 0 in 0.866s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:57 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 Jul 10 00:54:57 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (583ce996-9583-417f-a2e5-709d80ad9206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a7e96c-ba68-4e8b-8192-4d24a50c2a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a7e96c-ba68-4e8b-8192-4d24a50c2a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700423661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6831643a-affe-46a4-b6aa-66e53dcee859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:58Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df61c1-78cc-4165-be23-fdc809826909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df61c1-78cc-4165-be23-fdc809826909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5d6a47-c3e4-4216-9e16-28a4ad3bc41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5d6a47-c3e4-4216-9e16-28a4ad3bc41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6831643a-affe-46a4-b6aa-66e53dcee859', 'volume_name': 'volume-6831643a-affe-46a4-b6aa-66e53dcee859', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a157e35-bf11-42e1-b3d2-4002fe589c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a157e35-bf11-42e1-b3d2-4002fe589c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5876412-3be1-42c2-8fc8-16cfb82517a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:57 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume 6831643a-affe-46a4-b6aa-66e53dcee859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6831643a-affe-46a4-b6aa-66e53dcee859', 'volume_size': 1} Jul 10 00:54:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (385d0ea4-8820-4639-b3ab-0dae712afd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99af4c5e-8845-4153-9703-131ce00d7b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99af4c5e-8845-4153-9703-131ce00d7b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993726821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:58Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106d1d5f-ffce-4555-a2e4-c72d2f8b2c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106d1d5f-ffce-4555-a2e4-c72d2f8b2c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638cb95f-1200-419c-93e5-b86616970eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638cb95f-1200-419c-93e5-b86616970eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f', 'volume_name': 'volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d4807f-934d-462d-abbb-81155969f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d4807f-934d-462d-abbb-81155969f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5106730a-0034-4e0f-ba01-a84860cd0637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f', 'volume_size': 1} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:58 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 1G" returned: 0 in 1.023s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d444e59-d59f-4840-815c-3866e57aad1e -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:58 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d444e59-d59f-4840-815c-3866e57aad1e -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 Jul 10 00:54:58 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:58 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659" returned: 0 in 0.914s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:58 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659 Jul 10 00:54:58 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (9e277718-d256-4852-90cf-945cdb4b2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8985dff-39a4-4849-82d5-301444628073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8985dff-39a4-4849-82d5-301444628073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783903899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310714b6-5dd4-4097-8229-9b2ef238b728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:58Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6b62be-ba59-43c4-b520-54ed65e8e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6b62be-ba59-43c4-b520-54ed65e8e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebec3d74-64a5-4a53-845c-d7315a2e6072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebec3d74-64a5-4a53-845c-d7315a2e6072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310714b6-5dd4-4097-8229-9b2ef238b728', 'volume_name': 'volume-310714b6-5dd4-4097-8229-9b2ef238b728', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b813f0f-559b-4921-93b9-27a2f20f550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b813f0f-559b-4921-93b9-27a2f20f550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027a80a8-2f42-48e7-b4c7-35eae0535448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume 310714b6-5dd4-4097-8229-9b2ef238b728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310714b6-5dd4-4097-8229-9b2ef238b728', 'volume_size': 1} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (6b638031-be07-49f7-a84d-a36c6a0f4590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270b516e-f440-4505-9350-99c993eb565b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270b516e-f440-4505-9350-99c993eb565b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183412559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e89754-6076-438c-b696-2d9ed30832ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:59Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b9c6b0-d422-40ca-a1aa-0fe17a1a980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b9c6b0-d422-40ca-a1aa-0fe17a1a980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b55431b-4876-44bb-a90d-28e426c97f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b55431b-4876-44bb-a90d-28e426c97f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e89754-6076-438c-b696-2d9ed30832ed', 'volume_name': 'volume-e6e89754-6076-438c-b696-2d9ed30832ed', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7bf875-ac95-4f8b-b332-ae8376c770e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7bf875-ac95-4f8b-b332-ae8376c770e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d893338-de82-4a7a-9aca-69e54f907155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:58 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume e6e89754-6076-438c-b696-2d9ed30832ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e89754-6076-438c-b696-2d9ed30832ed', 'volume_size': 1} Jul 10 00:54:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:59 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da.5dabb8f0-3815-43dc-ae7d-83031f46f659" returned: 0 in 0.722s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-5dabb8f0-3815-43dc-ae7d-83031f46f659" released by "_delete_snapshot" :: held 3.382s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-10d50ca0-9ecb-495f-a7ad-8faeb59889da" released by "delete_snapshot" :: held 3.412s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Created reservations ['7a4c0200-ef6e-477a-9694-5915ee09eae4', 'b07535d5-25ff-4f4b-b580-10788489df42', 'c977a86c-943c-490c-b477-e5e97b7d4d26', 'e0e776e5-a830-49e2-b51e-d8e1bb62733b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:54:59 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Delete snapshot completed successfully. Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de5275c4-2fd8-4221-8a42-8cb03b769d16 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-5dabb8f0-3815-43dc-ae7d-83031f46f659-delete_snapshot" released by "delete_snapshot" :: held 3.588s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:54:59 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d444e59-d59f-4840-815c-3866e57aad1e -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638" returned: 0 in 1.017s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:54:59 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 is being set with open permissions: ugo+rw Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:54:59 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 Jul 10 00:54:59 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (2b68cbd6-19bb-4ac5-9b67-f7789ddbe990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d21f1b-a322-49a4-9b3b-128fb89819b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d21f1b-a322-49a4-9b3b-128fb89819b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-785309433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d9f5a9-a395-4bf9-9c56-3ae4787629b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:59Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75528a0c-f6e2-49c8-99a3-f909935b93c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75528a0c-f6e2-49c8-99a3-f909935b93c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9618dbc-932c-4bdc-9457-9dc7e735f6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9618dbc-932c-4bdc-9457-9dc7e735f6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d9f5a9-a395-4bf9-9c56-3ae4787629b7', 'volume_name': 'volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4223ce-57dc-4a59-a4ae-9ee097d1f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4223ce-57dc-4a59-a4ae-9ee097d1f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de4bd6d-1910-4f94-8cf9-efe6ffab3edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:54:59 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume 36d9f5a9-a395-4bf9-9c56-3ae4787629b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7', 'volume_size': 1} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-10d50ca0-9ecb-495f-a7ad-8faeb59889da-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:54:59 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-10d50ca0-9ecb-495f-a7ad-8faeb59889da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-quobyte-10d50ca0-9ecb-495f-a7ad-8faeb59889da" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:00 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-10d50ca0-9ecb-495f-a7ad-8faeb59889da" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638" returned: 0 in 0.741s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5019831-c58f-4862-b573-e56de93580ea]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:00 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.info Jul 10 00:55:00 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:00 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da Jul 10 00:55:00 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:00 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.info" returned: 0 in 0.649s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:00 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.info is being set with open permissions: ugo+rw Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:00 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.info Jul 10 00:55:00 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:00 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da" returned: 0 in 0.772s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:00 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da Jul 10 00:55:00 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:01 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.info" returned: 0 in 0.644s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.364s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79523544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020498c1-c302-47e8-ab70-4c475a19e266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:49Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Creating volume 020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:01 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:01 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 1073741824 Jul 10 00:55:01 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:01 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1e05ff68-4372-49b4-bf30-928bc06cdec7 tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:55:01 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-10d50ca0-9ecb-495f-a7ad-8faeb59889da" returned: 0 in 0.704s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-10d50ca0-9ecb-495f-a7ad-8faeb59889da" released by "delete_volume" :: held 1.548s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Created reservations ['b0517de7-cbfd-4ad4-a942-20f8b910beb5', 'e34460aa-01a1-4ec5-bed0-d8dab55526e4', 'e16169e7-624b-44c9-8003-8ac608a4574f', 'dcc41869-18d6-4af3-a326-d7268836d22b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:01 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:01 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-fe88284d-e5c0-4066-9bd8-776a7462d638-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Lock "cinder-fe88284d-e5c0-4066-9bd8-776a7462d638-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-3d444e59-d59f-4840-815c-3866e57aad1e" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-3d444e59-d59f-4840-815c-3866e57aad1e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-fe88284d-e5c0-4066-9bd8-776a7462d638" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-52966dc6-c8b1-4303-8baf-37a72671af63-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-fe88284d-e5c0-4066-9bd8-776a7462d638" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot fe88284d-e5c0-4066-9bd8-776a7462d638 of volume 3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-52966dc6-c8b1-4303-8baf-37a72671af63-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da7fae-8273-40c0-945e-19bc0d26b9eb]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "cinder-quobyte-52966dc6-c8b1-4303-8baf-37a72671af63" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-52966dc6-c8b1-4303-8baf-37a72671af63" acquired by "delete_volume" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:02 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 1073741824" returned: 0 in 0.952s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[067b4cb4-5977-4e2b-906d-6dafb7bf080d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:02 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 Jul 10 00:55:02 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:02 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 Jul 10 00:55:02 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:02 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 Jul 10 00:55:02 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:02 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.821s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Deleted volume successfully. Jul 10 00:55:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0bcf05a0-eaa8-4603-838d-ff981096cdc7 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-10d50ca0-9ecb-495f-a7ad-8faeb59889da-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:03 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638" returned: 0 in 0.838s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d444e59-d59f-4840-815c-3866e57aad1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99f6f85-fa0a-43f2-b452-5f9e79db4892]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:03 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266" returned: 0 in 0.729s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.390s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700423661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6831643a-affe-46a4-b6aa-66e53dcee859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:58Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Creating volume 6831643a-affe-46a4-b6aa-66e53dcee859 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:03 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:03 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63" returned: 0 in 0.813s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:03 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 1073741824 Jul 10 00:55:03 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d211ae-e3db-494f-8bad-f584012830b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020498c1-c302-47e8-ab70-4c475a19e266', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f2ab6d-ff08-45e0-a42c-2c4ce6f1dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:03 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63 Jul 10 00:55:03 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:03 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e Jul 10 00:55:03 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Volume volume-020498c1-c302-47e8-ab70-4c475a19e266 (020498c1-c302-47e8-ab70-4c475a19e266): created successfully Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f2ab6d-ff08-45e0-a42c-2c4ce6f1dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (425c09f0-c769-4a19-b81c-5d3dff16fb4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e8148421-1eb4-4742-915e-97de6a67f54f tempest-ProjectReaderTests-1003598966 None] Created volume successfully. Jul 10 00:55:03 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-52966dc6-c8b1-4303-8baf-37a72671af63" returned: 0 in 0.702s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-quobyte-52966dc6-c8b1-4303-8baf-37a72671af63" released by "delete_volume" :: held 1.572s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:03 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e" returned: 0 in 0.822s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:03 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 Jul 10 00:55:03 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Created reservations ['7386aca6-084f-4ef9-b1c4-8d4e5f9410f2', 'aaff00c0-5035-4c5e-a802-f0d61a8f01be', 'a276530b-5890-4f12-9744-509358637285', 'f3a37ea2-cf9a-4152-95cf-1f6b7ee8f72e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:04 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:04 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:04 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 1073741824" returned: 0 in 0.954s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:04 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 Jul 10 00:55:04 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:04 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638" returned: 0 in 0.945s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:04 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638 Jul 10 00:55:04 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:04 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.878s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:04 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:04 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Deleted volume successfully. Jul 10 00:55:05 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859" returned: 0 in 0.839s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ab218e6c-f022-4f5e-9e0c-b690b413d256 tempest-VolumeDependencyTests-416871117 None] Lock "cinder-52966dc6-c8b1-4303-8baf-37a72671af63-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.910s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993726821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:58Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Creating volume c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:05 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5876412-3be1-42c2-8fc8-16cfb82517a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6831643a-affe-46a4-b6aa-66e53dcee859', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:05 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f 1073741824 Jul 10 00:55:05 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80f1cb7-47d5-48b0-b5c1-586a3e7cbb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:05 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume volume-6831643a-affe-46a4-b6aa-66e53dcee859 (6831643a-affe-46a4-b6aa-66e53dcee859): created successfully Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80f1cb7-47d5-48b0-b5c1-586a3e7cbb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (583ce996-9583-417f-a2e5-709d80ad9206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2269cce1-a347-4338-b08d-a62aac7bbe71 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created volume successfully. Jul 10 00:55:05 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e.fe88284d-e5c0-4066-9bd8-776a7462d638" returned: 0 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-fe88284d-e5c0-4066-9bd8-776a7462d638" released by "_delete_snapshot" :: held 3.479s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-3d444e59-d59f-4840-815c-3866e57aad1e" released by "delete_snapshot" :: held 3.518s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Created reservations ['5d525b4b-2a03-423c-9412-91a5a25f012e', 'd69c158a-7ba4-43fb-9372-4651d786042f', '0b2a827f-2f5a-40c3-bfcd-0a6bac5cfde9', 'f69985d7-d565-4b9e-b711-4c2bc7305c6b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:55:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d4054c49-777b-47c8-84eb-3f53a63760d0 tempest-ProjectMemberTests-411910201 None] Lock "cinder-fe88284d-e5c0-4066-9bd8-776a7462d638-delete_snapshot" released by "delete_snapshot" :: held 3.710s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:06 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f 1073741824" returned: 0 in 1.034s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:06 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f Jul 10 00:55:06 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-3d444e59-d59f-4840-815c-3866e57aad1e-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Lock "cinder-3d444e59-d59f-4840-815c-3866e57aad1e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-3d444e59-d59f-4840-815c-3866e57aad1e" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-3d444e59-d59f-4840-815c-3866e57aad1e" acquired by "delete_volume" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcd3730-d56d-492a-9e62-c193bcc0b92b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:06 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e Jul 10 00:55:06 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:06 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f" returned: 0 in 0.758s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.338s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783903899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310714b6-5dd4-4097-8229-9b2ef238b728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:58Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Creating volume 310714b6-5dd4-4097-8229-9b2ef238b728 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:06 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5106730a-0034-4e0f-ba01-a84860cd0637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:06 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 1073741824 Jul 10 00:55:06 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b4ce13-28a4-469e-b0f5-45b0b7091335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:06 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f (c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f): created successfully Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b4ce13-28a4-469e-b0f5-45b0b7091335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:06 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (385d0ea4-8820-4639-b3ab-0dae712afd5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4bc04de3-d617-47c6-ab1b-ef7b3a2c0a21 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created volume successfully. Jul 10 00:55:07 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e" returned: 0 in 0.825s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:07 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e Jul 10 00:55:07 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:07 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 1073741824" returned: 0 in 0.925s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:07 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 Jul 10 00:55:07 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:08 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3d444e59-d59f-4840-815c-3866e57aad1e" returned: 0 in 0.723s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-3d444e59-d59f-4840-815c-3866e57aad1e" released by "delete_volume" :: held 1.651s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Created reservations ['341404c1-9b11-441f-bfaa-e665d401599d', '5b4e8448-3aac-4a79-8109-bf68613cfdb2', 'e0209784-ae1f-4fc2-8f1d-bcbf8251ad9d', 'e3d447be-b44e-49f2-90d9-daf277c8ebe5'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:08 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:08 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:08 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728" returned: 0 in 0.785s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.669s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183412559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e89754-6076-438c-b696-2d9ed30832ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:59Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Creating volume e6e89754-6076-438c-b696-2d9ed30832ed {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:08 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:08 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed 1073741824 Jul 10 00:55:08 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027a80a8-2f42-48e7-b4c7-35eae0535448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310714b6-5dd4-4097-8229-9b2ef238b728', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ffff0b-7d4f-4e98-82c1-66641f4323a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:08 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume volume-310714b6-5dd4-4097-8229-9b2ef238b728 (310714b6-5dd4-4097-8229-9b2ef238b728): created successfully Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ffff0b-7d4f-4e98-82c1-66641f4323a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:08 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (9e277718-d256-4852-90cf-945cdb4b2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-de06c627-a06e-4cd3-a743-b9cc3db1b15a tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created volume successfully. Jul 10 00:55:09 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-feb68bd6-ac6c-49c3-9205-591acbc037de tempest-ProjectMemberTests-411910201 None] Lock "cinder-3d444e59-d59f-4840-815c-3866e57aad1e-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (79faeaa3-6e73-455d-bdbe-7c0c9c85a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6897d9-78fe-46b7-9790-1f6388211205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6897d9-78fe-46b7-9790-1f6388211205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014469297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ec2dba-3182-42bb-a90f-2b701bc0d544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:09Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d04b8e-5fee-4e14-914f-b02e0d4c84dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d04b8e-5fee-4e14-914f-b02e0d4c84dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44999920-21f4-45fa-9148-a7571e8d52e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44999920-21f4-45fa-9148-a7571e8d52e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ec2dba-3182-42bb-a90f-2b701bc0d544', 'volume_name': 'volume-47ec2dba-3182-42bb-a90f-2b701bc0d544', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc297bcf-8ee6-4c41-839b-9a565db77946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc297bcf-8ee6-4c41-839b-9a565db77946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279beef-4006-4a9e-b5bd-b58cdc5e46b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:09 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Volume 47ec2dba-3182-42bb-a90f-2b701bc0d544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ec2dba-3182-42bb-a90f-2b701bc0d544', 'volume_size': 1} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:09 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed 1073741824" returned: 0 in 0.938s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:09 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed Jul 10 00:55:09 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:10 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed" returned: 0 in 0.659s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.882s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-785309433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d9f5a9-a395-4bf9-9c56-3ae4787629b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dcd8b46ce428badb807dc3b415c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:54:59Z,use_quota=True,user_id='218113494fc74db8b061364b5ccb5451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Creating volume 36d9f5a9-a395-4bf9-9c56-3ae4787629b7 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:10 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d893338-de82-4a7a-9aca-69e54f907155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e89754-6076-438c-b696-2d9ed30832ed', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:10 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 1073741824 Jul 10 00:55:10 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce540d41-c254-4eba-ace4-a999edc7352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:10 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume volume-e6e89754-6076-438c-b696-2d9ed30832ed (e6e89754-6076-438c-b696-2d9ed30832ed): created successfully Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce540d41-c254-4eba-ace4-a999edc7352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:10 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (6b638031-be07-49f7-a84d-a36c6a0f4590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-38ac6fbc-f2c5-42d0-a6e5-554140295aa4 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created volume successfully. Jul 10 00:55:11 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 1073741824" returned: 0 in 0.954s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:11 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 Jul 10 00:55:11 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:12 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7" returned: 0 in 0.718s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.648s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de4bd6d-1910-4f94-8cf9-efe6ffab3edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20865388-bdf7-4c4b-a68c-3648b164f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Creating offline snapshot 2e464b24-7811-42af-9bbb-74e70af24acf of volume 020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:55:12 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Volume volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 (36d9f5a9-a395-4bf9-9c56-3ae4787629b7): created successfully Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20865388-bdf7-4c4b-a68c-3648b164f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Flow 'volume_create_manager' (2b68cbd6-19bb-4ac5-9b67-f7789ddbe990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2c5618-75a6-4b67-9d7c-33dfe60221d0]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:12 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a4560556-02a2-4a69-8a58-d4692c8dc653 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created volume successfully. Jul 10 00:55:12 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 Jul 10 00:55:12 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-36d9f5a9-a395-4bf9-9c56-3ae4787629b7-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-36d9f5a9-a395-4bf9-9c56-3ae4787629b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-quobyte-36d9f5a9-a395-4bf9-9c56-3ae4787629b7" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-36d9f5a9-a395-4bf9-9c56-3ae4787629b7" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6c182a-9013-43b3-acb0-31a4322b1201]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:12 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 Jul 10 00:55:12 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:12 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266" returned: 0 in 0.833s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:12 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf 1G Jul 10 00:55:12 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:13 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7" returned: 0 in 0.918s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:13 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7 Jul 10 00:55:13 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:13 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf 1G" returned: 0 in 0.924s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-020498c1-c302-47e8-ab70-4c475a19e266 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:13 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-020498c1-c302-47e8-ab70-4c475a19e266 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf Jul 10 00:55:13 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:14 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-36d9f5a9-a395-4bf9-9c56-3ae4787629b7" returned: 0 in 0.715s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-36d9f5a9-a395-4bf9-9c56-3ae4787629b7" released by "delete_volume" :: held 1.698s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created reservations ['f5d7c2b7-2394-4c25-8b94-b4199f65a07f', '49648960-1b75-439f-a6ab-fa958d62f85b', 'cc649ff7-03d5-461f-b32b-1e50d1e934d3', 'a2d38b2f-3774-405f-bf04-9f8fd92948c3'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:14 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:14 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:14 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-020498c1-c302-47e8-ab70-4c475a19e266 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf" returned: 0 in 0.796s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:14 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf is being set with open permissions: ugo+rw Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:14 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf Jul 10 00:55:14 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-e6e89754-6076-438c-b696-2d9ed30832ed-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-e6e89754-6076-438c-b696-2d9ed30832ed-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-quobyte-e6e89754-6076-438c-b696-2d9ed30832ed" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-e6e89754-6076-438c-b696-2d9ed30832ed" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c910007-03c3-427d-842b-d8dbfcbdd08f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:15 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed Jul 10 00:55:15 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:15 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.895s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:15 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:15 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Deleted volume successfully. Jul 10 00:55:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0e6ab78f-9877-4ec1-abdf-5cd65395f634 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-36d9f5a9-a395-4bf9-9c56-3ae4787629b7-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:15 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf" returned: 0 in 0.908s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:15 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.info Jul 10 00:55:15 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:16 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed" returned: 0 in 0.960s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:16 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed Jul 10 00:55:16 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:16 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.info" returned: 0 in 0.668s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:16 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.info is being set with open permissions: ugo+rw Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:16 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.info Jul 10 00:55:16 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:16 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-e6e89754-6076-438c-b696-2d9ed30832ed" returned: 0 in 0.624s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-e6e89754-6076-438c-b696-2d9ed30832ed" released by "delete_volume" :: held 1.659s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created reservations ['66edde45-a363-435b-948e-55fceeb1e780', 'adcb0bce-8fe1-48c3-bb9e-4a255bfaeae7', '85b4879e-c840-4691-a3a0-f5c4ff674e4a', 'e4ebe8ef-ec4d-465c-a55c-02722ce95a24'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:16 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:16 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:16 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.info" returned: 0 in 0.692s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.950s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.617s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014469297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ec2dba-3182-42bb-a90f-2b701bc0d544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:09Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Creating volume 47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:16 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:17 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 1073741824 Jul 10 00:55:17 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-2440356d-5196-41f8-b555-73c6200f8a8f tempest-ProjectReaderTests-1003598966 None] Create snapshot completed successfully Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-310714b6-5dd4-4097-8229-9b2ef238b728-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-310714b6-5dd4-4097-8229-9b2ef238b728-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-quobyte-310714b6-5dd4-4097-8229-9b2ef238b728" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-310714b6-5dd4-4097-8229-9b2ef238b728" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eb81c3-17bc-4dad-ba8b-86f177fe6866]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:17 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 Jul 10 00:55:17 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-2e464b24-7811-42af-9bbb-74e70af24acf-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:17 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.796s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-2e464b24-7811-42af-9bbb-74e70af24acf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-020498c1-c302-47e8-ab70-4c475a19e266" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:17 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Deleted volume successfully. Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-020498c1-c302-47e8-ab70-4c475a19e266" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-2e464b24-7811-42af-9bbb-74e70af24acf" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e3218b6d-79cd-422c-b7da-91260cfac390 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-e6e89754-6076-438c-b696-2d9ed30832ed-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-2e464b24-7811-42af-9bbb-74e70af24acf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Deleting offline snapshot 2e464b24-7811-42af-9bbb-74e70af24acf of volume 020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] snapshot_file for this snap is: volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3182878-9272-42a2-aa32-64cf9a6555cc]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:17 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf Jul 10 00:55:17 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:18 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 1073741824" returned: 0 in 1.155s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:18 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 Jul 10 00:55:18 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:18 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728" returned: 0 in 1.092s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:18 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728 Jul 10 00:55:18 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:18 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf" returned: 0 in 1.048s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-020498c1-c302-47e8-ab70-4c475a19e266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c23b451-716e-4eaf-8054-8fb212246732]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:18 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 Jul 10 00:55:18 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:19 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544" returned: 0 in 0.918s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4279beef-4006-4a9e-b5bd-b58cdc5e46b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ec2dba-3182-42bb-a90f-2b701bc0d544', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a593068-2b18-4cd2-ad5e-1497f4fe154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:19 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Volume volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 (47ec2dba-3182-42bb-a90f-2b701bc0d544): created successfully Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a593068-2b18-4cd2-ad5e-1497f4fe154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (79faeaa3-6e73-455d-bdbe-7c0c9c85a359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:19 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-310714b6-5dd4-4097-8229-9b2ef238b728" returned: 0 in 0.839s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:19 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8e56717f-e3fc-4786-abc2-dd51950b7d57 tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-310714b6-5dd4-4097-8229-9b2ef238b728" released by "delete_volume" :: held 1.993s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created reservations ['23b49e17-784c-430d-bdf4-9d2288d839a6', '621abee3-eeae-4735-aef5-6b3f28f27f16', '88124714-eaf6-44bc-bc12-a494ddcabe37', '63966351-8c49-4e83-9fde-78266aa0cece'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:19 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:19 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-quobyte-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aee279-93c2-49c3-959a-38556a3ff451]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:19 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266" returned: 0 in 0.958s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:19 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f Jul 10 00:55:19 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:19 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf Jul 10 00:55:19 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Creating offline snapshot e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 of volume 47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9840e070-ded3-4312-a39c-43e74a79edf4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:20 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.000s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Deleted volume successfully. Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-132a0a13-83b3-4c74-aca0-d9238dd07b12 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-310714b6-5dd4-4097-8229-9b2ef238b728-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:20 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 Jul 10 00:55:20 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:20 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f" returned: 0 in 1.048s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:20 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f Jul 10 00:55:20 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:20 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf" returned: 0 in 1.019s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:20 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf Jul 10 00:55:20 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:21 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544" returned: 0 in 0.953s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:21 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 1G Jul 10 00:55:21 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:21 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266.2e464b24-7811-42af-9bbb-74e70af24acf" returned: 0 in 0.708s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:21 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f" returned: 0 in 0.844s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-2e464b24-7811-42af-9bbb-74e70af24acf" released by "_delete_snapshot" :: held 3.893s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-020498c1-c302-47e8-ab70-4c475a19e266" released by "delete_snapshot" :: held 3.929s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f" released by "delete_volume" :: held 1.959s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created reservations ['94455e82-6c4e-439e-86c6-032e640577cd', 'b89040ab-afe0-44be-8023-ee16fb94dd78', 'f8b22b06-12de-4f0f-a867-3c032176ad61', 'bc5846cf-37ba-4d13-bd7e-81147cc10fe8'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Created reservations ['928daf52-67ff-4508-8472-771fadd828b1', 'df6bd0d9-0496-4af8-8400-692d1babbbec', '965b3615-2d09-4160-a39b-a36648ff05be', '2fd757ab-0787-4b2b-894b-2647f9324b40'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:21 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:21 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:21 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Delete snapshot completed successfully. Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a090b22-0d16-420d-8e4a-8480865effa8 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-2e464b24-7811-42af-9bbb-74e70af24acf-delete_snapshot" released by "delete_snapshot" :: held 4.221s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-6831643a-affe-46a4-b6aa-66e53dcee859-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-6831643a-affe-46a4-b6aa-66e53dcee859-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-quobyte-6831643a-affe-46a4-b6aa-66e53dcee859" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-6831643a-affe-46a4-b6aa-66e53dcee859" acquired by "delete_volume" :: waited 0.047s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f569495-7272-4239-a994-eb1faaeca8d1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-020498c1-c302-47e8-ab70-4c475a19e266-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Lock "cinder-020498c1-c302-47e8-ab70-4c475a19e266-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-020498c1-c302-47e8-ab70-4c475a19e266" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-020498c1-c302-47e8-ab70-4c475a19e266" acquired by "delete_volume" :: waited 0.033s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:22 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 Jul 10 00:55:22 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[129859f4-5a94-4199-a541-cb815124fe97]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:22 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Flow 'volume_create_manager' (411d1e3c-9528-4bab-9e7a-05fd675189a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c2d277-8677-415f-877a-955fbbdf27ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 1G" returned: 0 in 1.178s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c2d277-8677-415f-877a-955fbbdf27ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278024865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05881dfb-5443-42f0-928e-30d7f2f8845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df29137e4d284c2e969ac7d0fb25e42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:22Z,use_quota=True,user_id='79eec2d4f2c44736b06140fb238698e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021eae80-a762-4525-bb83-d59bc8443f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:22 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 Jul 10 00:55:22 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021eae80-a762-4525-bb83-d59bc8443f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394b3185-dc74-4824-8319-d7c59f9a7cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:22 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394b3185-dc74-4824-8319-d7c59f9a7cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05881dfb-5443-42f0-928e-30d7f2f8845b', 'volume_name': 'volume-05881dfb-5443-42f0-928e-30d7f2f8845b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:22 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46ac563-51d5-427a-9d85-05e42969426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46ac563-51d5-427a-9d85-05e42969426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06072fd-3277-4c0b-b283-82b0de8d075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:22 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Volume 05881dfb-5443-42f0-928e-30d7f2f8845b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05881dfb-5443-42f0-928e-30d7f2f8845b', 'volume_size': 1} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:22 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.016s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:22 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Deleted volume successfully. Jul 10 00:55:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48c39e35-591c-41ae-ab21-034cec3fbfae tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-c8ba2dc1-2dcf-4edd-8f31-77ec0daadf5f-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:23 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859" returned: 0 in 0.982s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:23 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859 Jul 10 00:55:23 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:23 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" returned: 0 in 0.799s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:23 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 is being set with open permissions: ugo+rw Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:23 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266" returned: 0 in 0.917s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:23 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 Jul 10 00:55:23 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:23 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266 Jul 10 00:55:23 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:23 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-6831643a-affe-46a4-b6aa-66e53dcee859" returned: 0 in 0.664s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-6831643a-affe-46a4-b6aa-66e53dcee859" released by "delete_volume" :: held 1.701s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created reservations ['7481b735-dfe8-490d-a9b5-0c09a4952620', '9ccba790-c088-4889-95e4-3360f61aeb97', '6a986583-0f5d-4d4c-9957-11cf3fc8d7b8', '9fbe33c8-e1fb-49b8-9c87-8569eb754495'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:23 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:23 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:23 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" returned: 0 in 0.714s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:23 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-020498c1-c302-47e8-ab70-4c475a19e266" returned: 0 in 0.742s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:24 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.info Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-020498c1-c302-47e8-ab70-4c475a19e266" released by "delete_volume" :: held 1.762s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:24 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Created reservations ['905529bd-8494-4c0a-babc-2a6fd44cdbfd', '0d387ba2-1d2a-4227-8fdd-9a499b9fd3a4', '04e24146-b416-434f-91de-ace4ccc7fd3e', '250dc8b1-a146-4144-90bf-61de80fe810e'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:24 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:24 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "cinder-quobyte-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf35c08-1813-4681-9346-06f8cbaa53fa]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:24 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf Jul 10 00:55:24 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:24 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.812s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:24 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Deleted volume successfully. Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-06092de6-03cc-467b-aac4-147df61b9cc2 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-6831643a-affe-46a4-b6aa-66e53dcee859-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:24 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.info" returned: 0 in 0.887s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:24 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.info is being set with open permissions: ugo+rw Jul 10 00:55:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:24 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.info Jul 10 00:55:24 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:25 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf" returned: 0 in 0.900s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:25 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf Jul 10 00:55:25 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:25 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (68536b76-7577-4db6-a3c6-36d6fa4b36e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e508dea3-5ab8-410f-8933-5798593e95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.140s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Deleted volume successfully. Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e508dea3-5ab8-410f-8933-5798593e95b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30333415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12d8ada-7e3d-44a5-9769-e53bcc8908eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:25Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e2bf41-98a6-49bd-91fd-ac9e4eb574d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e2bf41-98a6-49bd-91fd-ac9e4eb574d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9779e6-a32e-44d4-8506-aa7964d76721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9779e6-a32e-44d4-8506-aa7964d76721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12d8ada-7e3d-44a5-9769-e53bcc8908eb', 'volume_name': 'volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e637518-92f8-47a8-9f25-0d1b7c65f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e637518-92f8-47a8-9f25-0d1b7c65f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59852ed2-82b1-4752-b12e-a63d12b02661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:25 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Volume d12d8ada-7e3d-44a5-9769-e53bcc8908eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb', 'volume_size': 1} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee044164-039a-4b3a-8305-6f715e8fd46e tempest-ProjectReaderTests-1003598966 None] Lock "cinder-020498c1-c302-47e8-ab70-4c475a19e266-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:25 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.info" returned: 0 in 0.742s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.383s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.123s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278024865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05881dfb-5443-42f0-928e-30d7f2f8845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df29137e4d284c2e969ac7d0fb25e42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:22Z,use_quota=True,user_id='79eec2d4f2c44736b06140fb238698e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Creating volume 05881dfb-5443-42f0-928e-30d7f2f8845b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:25 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:25 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b 1073741824 Jul 10 00:55:25 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-c4f3aa36-965f-4794-8dea-b2999089bd1f tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:55:25 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf" returned: 0 in 0.736s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-quobyte-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf" released by "delete_volume" :: held 1.691s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Created reservations ['b2dd263f-048a-40c0-adca-22a20ffe2fcd', 'e8c6ac41-700b-4d54-921a-30f3c72e05ca', 'ff4481a2-0f38-4f4a-ab1a-cecb7a679940', '4559f14f-fa88-4a4f-b20c-bfbc1316890f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:26 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:26 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Lock "cinder-e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-47ec2dba-3182-42bb-a90f-2b701bc0d544" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:26 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b 1073741824" returned: 0 in 0.991s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-47ec2dba-3182-42bb-a90f-2b701bc0d544" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 of volume 47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab8716-675d-4d0e-9da7-9459271e061b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:26 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b Jul 10 00:55:26 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:26 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.711s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Deleted volume successfully. Jul 10 00:55:26 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 Jul 10 00:55:26 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3019c397-f384-41d1-b756-5bddff401b93 tempest-CreateVolumesFromSourceVolumeTest-6118554 None] Lock "cinder-4fef76da-17c6-4dba-9901-bdd7cf6bd1cf-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:27 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b" returned: 0 in 0.758s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30333415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12d8ada-7e3d-44a5-9769-e53bcc8908eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:25Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Creating volume d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:27 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:27 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb 1073741824 Jul 10 00:55:27 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06072fd-3277-4c0b-b283-82b0de8d075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05881dfb-5443-42f0-928e-30d7f2f8845b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49227e1-10f0-407e-ab5e-20c0bd284138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:27 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Volume volume-05881dfb-5443-42f0-928e-30d7f2f8845b (05881dfb-5443-42f0-928e-30d7f2f8845b): created successfully Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49227e1-10f0-407e-ab5e-20c0bd284138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Flow 'volume_create_manager' (411d1e3c-9528-4bab-9e7a-05fd675189a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:27 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a173034f-2dd8-4f97-89e4-624385556bb1 tempest-ProjectReaderTests-1331866242 None] Created volume successfully. Jul 10 00:55:27 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" returned: 0 in 0.996s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47ec2dba-3182-42bb-a90f-2b701bc0d544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e796fd6-95fe-43a3-a240-54b0209ade93]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:27 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 Jul 10 00:55:27 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:28 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb 1073741824" returned: 0 in 0.961s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:28 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb Jul 10 00:55:28 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:28 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544" returned: 0 in 0.896s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:28 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 Jul 10 00:55:28 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:28 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Acquiring lock "cinder-05881dfb-5443-42f0-928e-30d7f2f8845b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Lock "cinder-05881dfb-5443-42f0-928e-30d7f2f8845b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Acquiring lock "cinder-quobyte-05881dfb-5443-42f0-928e-30d7f2f8845b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Lock "cinder-quobyte-05881dfb-5443-42f0-928e-30d7f2f8845b" acquired by "delete_volume" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f9287-7cd7-463a-a2ac-e8e77d806b69]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:29 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" returned: 0 in 0.748s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:29 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b Jul 10 00:55:29 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59852ed2-82b1-4752-b12e-a63d12b02661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15cbd58-ac9e-417b-801b-c67685c0908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:29 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Volume volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb (d12d8ada-7e3d-44a5-9769-e53bcc8908eb): created successfully Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15cbd58-ac9e-417b-801b-c67685c0908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (68536b76-7577-4db6-a3c6-36d6fa4b36e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:29 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e35dc357-ae60-4b3d-ba3d-804b7d2a704c tempest-ProjectReaderTests-1003598966 None] Created volume successfully. Jul 10 00:55:29 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" returned: 0 in 0.924s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:29 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4 Jul 10 00:55:29 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:29 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b" returned: 0 in 0.868s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:30 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b Jul 10 00:55:30 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:30 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544.e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" returned: 0 in 0.661s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4" released by "_delete_snapshot" :: held 3.651s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-47ec2dba-3182-42bb-a90f-2b701bc0d544" released by "delete_snapshot" :: held 3.692s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Created reservations ['2050d807-b1c9-4e3c-9a7a-828307a00f51', 'b22c7bfd-6896-48a4-abed-76a9285794eb', 'bbf6d745-de76-48da-b09f-7961f4d4011a', '2297e1b6-6464-4e07-addf-e409350efabc'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-ee0e142b-1150-48c7-9b84-1ab1529144d7 tempest-ProjectMemberTests-411910201 None] Lock "cinder-e747d4fb-337d-4cd6-8ea2-b110c6f4f6c4-delete_snapshot" released by "delete_snapshot" :: held 3.872s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Creating offline snapshot 9bca51cf-7f42-4273-947f-037c386e8d50 of volume d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf4483-66ed-4741-b790-248d68770efe]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:30 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-05881dfb-5443-42f0-928e-30d7f2f8845b" returned: 0 in 0.835s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Lock "cinder-quobyte-05881dfb-5443-42f0-928e-30d7f2f8845b" released by "delete_volume" :: held 1.773s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:30 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb Jul 10 00:55:30 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Created reservations ['c8ef3068-a224-409f-9e56-a11047e03df0', '67e7d551-c8bf-4005-ab6a-ea0fc6690583', '266ad4bc-1f74-4cd0-9174-1d1b8d347fe6', 'b55f93a5-f2bf-40ae-b315-fa3dc39cd451'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-47ec2dba-3182-42bb-a90f-2b701bc0d544-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:30 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Lock "cinder-47ec2dba-3182-42bb-a90f-2b701bc0d544-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-47ec2dba-3182-42bb-a90f-2b701bc0d544" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:31 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:31 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-47ec2dba-3182-42bb-a90f-2b701bc0d544" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd564ff5-24b5-492d-be41-9a4b49e8d7b7]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:31 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 Jul 10 00:55:31 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:31 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" returned: 0 in 1.125s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:31 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 1G Jul 10 00:55:31 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:32 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Flow 'volume_create_manager' (9e767ae1-0571-4b66-9233-3e05ac8b741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8640ec0f-e590-4f87-bfcc-ac678db8b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.056s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:32 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Deleted volume successfully. Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8640ec0f-e590-4f87-bfcc-ac678db8b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806404529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02566f72-4f0e-4d14-8f3a-ea4272345027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df29137e4d284c2e969ac7d0fb25e42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:32Z,use_quota=True,user_id='79eec2d4f2c44736b06140fb238698e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfb597f-c020-42b9-b5f7-613072f20aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfb597f-c020-42b9-b5f7-613072f20aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37796896-b218-471c-b49d-8b5c49e46737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37796896-b218-471c-b49d-8b5c49e46737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02566f72-4f0e-4d14-8f3a-ea4272345027', 'volume_name': 'volume-02566f72-4f0e-4d14-8f3a-ea4272345027', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be001b-9931-4adf-8459-fd82515ce8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8be001b-9931-4adf-8459-fd82515ce8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f705b7-575a-4714-95f2-784a42c4f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:32 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Volume 02566f72-4f0e-4d14-8f3a-ea4272345027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02566f72-4f0e-4d14-8f3a-ea4272345027', 'volume_size': 1} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-1186f3c0-fca6-4b7a-b0ba-d09d34aadd7a tempest-ProjectReaderTests-1331866242 None] Lock "cinder-05881dfb-5443-42f0-928e-30d7f2f8845b-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:32 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544" returned: 0 in 1.102s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:32 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544 Jul 10 00:55:32 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:32 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 1G" returned: 0 in 1.006s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:32 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 Jul 10 00:55:32 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:32 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Flow 'volume_create_manager' (6811466f-4153-4777-b346-a5ba7e8cab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3d221a-7049-4fa2-9f5d-10909c443865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3d221a-7049-4fa2-9f5d-10909c443865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3cda45c-0c33-467b-9f00-a6b42aec1eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a497378a34d54014b10b99d80ed2451d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:33Z,use_quota=True,user_id='46fc228431f847b2a4f12e5afb5f2f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869eaf40-85d1-4d48-bf51-b6d681610067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869eaf40-85d1-4d48-bf51-b6d681610067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8156b765-1a1d-4d63-8eb6-39a93a242d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.image.glance [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Creating Keystone auth plugin from conf {{(pid=87452) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:55:33 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-47ec2dba-3182-42bb-a90f-2b701bc0d544" returned: 0 in 0.818s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-47ec2dba-3182-42bb-a90f-2b701bc0d544" released by "delete_volume" :: held 1.995s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Created reservations ['dd4c2c1a-d49a-4e89-8ee5-26774ebf6a0e', 'eb449ec0-a0dd-4c8c-b74e-6e703f6f2a9c', '99758887-9f92-4897-85ca-571435ef6d2a', '69f4f66f-58b3-4b7d-824d-1dc074706318'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:33 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:33 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8156b765-1a1d-4d63-8eb6-39a93a242d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3cda45c-0c33-467b-9f00-a6b42aec1eff', 'volume_name': 'volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff', 'volume_size': 1, 'image_id': 'a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9be5b8a5b673600b0fc34e517bc1acd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a497378a34d54014b10b99d80ed2451d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7bff3e27bbbdf7621971e58295b6c43d0414896e1d3325e866ebfdf4d59dd2b0ef52e44e1f6933c998121b854ef2685814c8ab5570d2f06f9a937d5607f96338', 'id': 'a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'created_at': datetime.datetime(2026, 7, 9, 22, 55, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 55, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4/file', 'properties': {}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2f2004-5aea-4c85-acda-3343b5abc228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2f2004-5aea-4c85-acda-3343b5abc228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66bc03e-b9ae-4e6d-b721-9e5594e54e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:33 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Volume c3cda45c-0c33-467b-9f00-a6b42aec1eff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff', 'volume_size': 1, 'image_id': 'a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9be5b8a5b673600b0fc34e517bc1acd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a497378a34d54014b10b99d80ed2451d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7bff3e27bbbdf7621971e58295b6c43d0414896e1d3325e866ebfdf4d59dd2b0ef52e44e1f6933c998121b854ef2685814c8ab5570d2f06f9a937d5607f96338', 'id': 'a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'created_at': datetime.datetime(2026, 7, 9, 22, 55, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 55, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4/file', 'properties': {}}, 'image_service': } Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Trying to clone c3cda45c-0c33-467b-9f00-a6b42aec1eff from image a8e13495-7b96-49c4-a9fa-6458691fa3e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'metadata': {}}]). {{(pid=87452) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:55:33 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8594e8-fab5-4e76-a3b1-c49fc6c04c16]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:33 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50" returned: 0 in 0.767s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:33 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 is being set with open permissions: ugo+rw Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:33 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD Jul 10 00:55:33 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:33 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 Jul 10 00:55:33 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:33 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.692s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:33 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:55:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e94c61d7-929e-4eef-8ad5-8cdf9f87147b tempest-ProjectMemberTests-411910201 None] Lock "cinder-47ec2dba-3182-42bb-a90f-2b701bc0d544-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:34 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:34 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD Jul 10 00:55:34 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:34 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50" returned: 0 in 0.761s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:34 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.info Jul 10 00:55:34 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (b118ff77-fdad-4857-ad2c-7e0fa9c6e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c1afc-9dc6-4126-a870-f3362f3212ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c1afc-9dc6-4126-a870-f3362f3212ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474945361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8175444-4b62-4ce4-9959-a091618bf450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:35Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db5b981-70db-4823-b47e-d1e310c50f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db5b981-70db-4823-b47e-d1e310c50f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a006f8c-f50a-49fe-8415-121e937d4b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a006f8c-f50a-49fe-8415-121e937d4b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8175444-4b62-4ce4-9959-a091618bf450', 'volume_name': 'volume-d8175444-4b62-4ce4-9959-a091618bf450', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5457d73b-b833-4883-a8d3-eca077b30ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5457d73b-b833-4883-a8d3-eca077b30ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d781dd3-955c-4c9a-855f-84de0cf52b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:34 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Volume d8175444-4b62-4ce4-9959-a091618bf450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8175444-4b62-4ce4-9959-a091618bf450', 'volume_size': 1} Jul 10 00:55:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:35 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Temporary image a8e13495-7b96-49c4-a9fa-6458691fa3e4 is fetched for user 46fc228431f847b2a4f12e5afb5f2f60. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a803f05e-0907-42b0-903a-60f24a75ecce]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:35 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.info" returned: 0 in 0.782s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:35 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.info is being set with open permissions: ugo+rw Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:35 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.info Jul 10 00:55:35 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:35 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD Jul 10 00:55:35 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:35 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:35 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.info" returned: 0 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.819s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806404529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02566f72-4f0e-4d14-8f3a-ea4272345027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df29137e4d284c2e969ac7d0fb25e42d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:32Z,use_quota=True,user_id='79eec2d4f2c44736b06140fb238698e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Creating volume 02566f72-4f0e-4d14-8f3a-ea4272345027 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:36 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:36 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 1073741824 Jul 10 00:55:36 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:36 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a24fd919-a343-4269-bc77-2a99a7617e18 tempest-ProjectReaderTests-1003598966 None] Create snapshot completed successfully Jul 10 00:55:36 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD Jul 10 00:55:36 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:36 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD" returned: 1 in 0.808s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:36 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 1073741824" returned: 0 in 0.915s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:37 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 Jul 10 00:55:37 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-9bca51cf-7f42-4273-947f-037c386e8d50-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Lock "cinder-9bca51cf-7f42-4273-947f-037c386e8d50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-9bca51cf-7f42-4273-947f-037c386e8d50" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-9bca51cf-7f42-4273-947f-037c386e8d50" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Deleting offline snapshot 9bca51cf-7f42-4273-947f-037c386e8d50 of volume d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] snapshot_file for this snap is: volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee561645-1606-42d7-840d-627a250d2e0f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:37 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 Jul 10 00:55:37 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:37 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027" returned: 0 in 0.691s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.807s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474945361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8175444-4b62-4ce4-9959-a091618bf450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:35Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Creating volume d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:37 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:37 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 1073741824 Jul 10 00:55:37 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f705b7-575a-4714-95f2-784a42c4f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02566f72-4f0e-4d14-8f3a-ea4272345027', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f397edd0-42c6-4802-ab98-929f06baa4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:37 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Volume volume-02566f72-4f0e-4d14-8f3a-ea4272345027 (02566f72-4f0e-4d14-8f3a-ea4272345027): created successfully Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f397edd0-42c6-4802-ab98-929f06baa4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:37 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Flow 'volume_create_manager' (9e767ae1-0571-4b66-9233-3e05ac8b741c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:37 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-98900aba-a941-4649-86f3-0d683f7dc0c2 tempest-ProjectReaderTests-1331866242 None] Created volume successfully. Jul 10 00:55:38 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50" returned: 0 in 0.899s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[430434b7-a047-4164-914e-eff40b32a19d]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:38 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb Jul 10 00:55:38 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Acquiring lock "cinder-02566f72-4f0e-4d14-8f3a-ea4272345027-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Lock "cinder-02566f72-4f0e-4d14-8f3a-ea4272345027-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Acquiring lock "cinder-quobyte-02566f72-4f0e-4d14-8f3a-ea4272345027" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Lock "cinder-quobyte-02566f72-4f0e-4d14-8f3a-ea4272345027" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e99bda-5764-4caf-9335-7a8c83d4cd73]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:38 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 1073741824" returned: 0 in 0.923s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:38 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 Jul 10 00:55:38 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:38 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 Jul 10 00:55:38 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:38 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" returned: 0 in 0.842s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:38 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 Jul 10 00:55:38 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:39 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450" returned: 0 in 0.683s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.552s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3cda45c-0c33-467b-9f00-a6b42aec1eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a497378a34d54014b10b99d80ed2451d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:33Z,use_quota=True,user_id='46fc228431f847b2a4f12e5afb5f2f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Creating volume c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:39 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:39 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027" returned: 0 in 0.823s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:39 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff 1073741824 Jul 10 00:55:39 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d781dd3-955c-4c9a-855f-84de0cf52b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8175444-4b62-4ce4-9959-a091618bf450', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c3f259-3c4d-4d0a-8506-1034e7cea6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:39 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027 Jul 10 00:55:39 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:39 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Volume volume-d8175444-4b62-4ce4-9959-a091618bf450 (d8175444-4b62-4ce4-9959-a091618bf450): created successfully Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c3f259-3c4d-4d0a-8506-1034e7cea6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (b118ff77-fdad-4857-ad2c-7e0fa9c6e56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:39 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7f3434f2-64a7-44fa-81e3-e8866d89e644 tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:55:39 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50" returned: 0 in 0.821s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:39 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50 Jul 10 00:55:39 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:40 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-02566f72-4f0e-4d14-8f3a-ea4272345027" returned: 0 in 0.672s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Lock "cinder-quobyte-02566f72-4f0e-4d14-8f3a-ea4272345027" released by "delete_volume" :: held 1.542s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Created reservations ['caca84ec-dada-4152-9a3d-0c1c0a0450ee', '3d8ac6c4-18b2-408d-8b8f-e6bfe936cc2e', '8270eb45-bc2e-42e6-933c-949169dfb427', 'e5545f1c-2bc1-41f1-9170-8c3cece55144'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:40 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:40 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:40 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff 1073741824" returned: 0 in 0.980s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:40 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff Jul 10 00:55:40 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:40 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb.9bca51cf-7f42-4273-947f-037c386e8d50" returned: 0 in 0.795s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-9bca51cf-7f42-4273-947f-037c386e8d50" released by "_delete_snapshot" :: held 3.502s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" released by "delete_snapshot" :: held 3.535s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Created reservations ['c977411e-3941-4368-abb8-e7225f201579', '8b06581d-a1c9-4dca-9a9e-81ecbf6d7b11', '4c7fe2fa-eb25-4a7e-9d67-ad8ee542acb7', 'f9c8976b-9888-4e4d-9fe3-3ae8869512ae'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Delete snapshot completed successfully. Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-e4c79312-9edd-474d-b4dd-e275c7e8bbbd tempest-ProjectReaderTests-1003598966 None] Lock "cinder-9bca51cf-7f42-4273-947f-037c386e8d50-delete_snapshot" released by "delete_snapshot" :: held 3.732s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:40 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.721s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:40 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Deleted volume successfully. Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3305082a-4e2c-476f-a488-a3264a47fe17 tempest-ProjectReaderTests-1331866242 None] Lock "cinder-02566f72-4f0e-4d14-8f3a-ea4272345027-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:41 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff" returned: 0 in 0.713s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.801s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Creating offline snapshot 3904aa15-11a0-4a01-8751-fd157ee83ec4 of volume d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Attempting download of a8e13495-7b96-49c4-a9fa-6458691fa3e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'metadata': {}}])) to volume c3cda45c-0c33-467b-9f00-a6b42aec1eff. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[64349baa-b5ea-4764-972a-063a1ba403ad]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad3731-a5a1-4696-918d-feeea00ac847]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8e13495-7b96-49c4-a9fa-6458691fa3e4_g9d5186i {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:41 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 Jul 10 00:55:41 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:41 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8e13495-7b96-49c4-a9fa-6458691fa3e4_g9d5186i Jul 10 00:55:41 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-d12d8ada-7e3d-44a5-9769-e53bcc8908eb-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Lock "cinder-d12d8ada-7e3d-44a5-9769-e53bcc8908eb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" acquired by "delete_volume" :: waited 0.031s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[874a7706-712f-4975-ab31-37bacdcce28e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:41 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb Jul 10 00:55:41 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:42 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:42 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8e13495-7b96-49c4-a9fa-6458691fa3e4_g9d5186i" returned: 0 in 0.911s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8e13495-7b96-49c4-a9fa-6458691fa3e4_g9d5186i {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450" returned: 0 in 0.975s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:42 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 1G Jul 10 00:55:42 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:42 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8e13495-7b96-49c4-a9fa-6458691fa3e4_g9d5186i Jul 10 00:55:42 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:42 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" returned: 0 in 0.969s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:42 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb Jul 10 00:55:42 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:42 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8e13495-7b96-49c4-a9fa-6458691fa3e4_g9d5186i" returned: 1 in 0.879s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8e13495-7b96-49c4-a9fa-6458691fa3e4_g9d5186i' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b14f19a-07d3-4d22-9cca-9973e9a1becd]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:43 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD Jul 10 00:55:43 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:43 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 1G" returned: 0 in 1.040s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8175444-4b62-4ce4-9959-a091618bf450 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:43 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8175444-4b62-4ce4-9959-a091618bf450 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 Jul 10 00:55:43 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:43 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" returned: 0 in 0.850s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-d12d8ada-7e3d-44a5-9769-e53bcc8908eb" released by "delete_volume" :: held 1.922s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Created reservations ['c0446be3-4e46-45ab-a88c-dc1a2713723c', '6b8a00d5-c7a7-4616-8ba8-8337d9702681', 'd011db03-f753-4574-8443-59a001094549', '2e17c4e8-a4fe-4c93-9ff7-1b74607f150f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:43 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:43 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:43 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD" returned: 0 in 0.998s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:44 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8175444-4b62-4ce4-9959-a091618bf450 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4" returned: 0 in 0.996s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:44 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 is being set with open permissions: ugo+rw Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:44 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD Jul 10 00:55:44 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:44 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 Jul 10 00:55:44 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (9c5a1b26-a37f-4d52-a96c-27b6bf0ea6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178fb0ad-501c-4ea4-b871-07852d147981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178fb0ad-501c-4ea4-b871-07852d147981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010105118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e698e6-24f5-4ce2-bb65-712e1b755464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:44Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7882c4-6846-4f38-8cab-420c672aee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7882c4-6846-4f38-8cab-420c672aee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a20945c-bfce-49d1-9070-456950be45d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a20945c-bfce-49d1-9070-456950be45d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e698e6-24f5-4ce2-bb65-712e1b755464', 'volume_name': 'volume-39e698e6-24f5-4ce2-bb65-712e1b755464', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4328e84-73a4-4842-8353-ebd24b015e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4328e84-73a4-4842-8353-ebd24b015e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bed738-5bfe-456b-9533-84d700e8cd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:44 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Volume 39e698e6-24f5-4ce2-bb65-712e1b755464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e698e6-24f5-4ce2-bb65-712e1b755464', 'volume_size': 1} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:44 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 1.011s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:44 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Deleted volume successfully. Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-24cc17fd-6a35-42ac-8bf1-0f31193b6abf tempest-ProjectReaderTests-1003598966 None] Lock "cinder-d12d8ada-7e3d-44a5-9769-e53bcc8908eb-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:44 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD" returned: 1 in 0.872s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] a8e13495-7b96-49c4-a9fa-6458691fa3e4 was raw, converting to raw {{(pid=87452) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:55:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:44 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff Jul 10 00:55:44 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:45 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4" returned: 0 in 0.883s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:45 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.info Jul 10 00:55:45 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:45 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff" returned: 0 in 0.808s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:45 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a8e13495-7b96-49c4-a9fa-6458691fa3e4_a9iqo55mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:55:45 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:55:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:45 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff 1G Jul 10 00:55:45 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:45 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.info" returned: 0 in 0.743s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:45 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.info is being set with open permissions: ugo+rw Jul 10 00:55:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:45 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.info Jul 10 00:55:45 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:46 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff 1G" returned: 0 in 0.747s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05be18c-1074-4abc-8432-9d65c82bc18f]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:46 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.info" returned: 0 in 0.718s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.464s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.047s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010105118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e698e6-24f5-4ce2-bb65-712e1b755464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:44Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Creating volume 39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:46 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:46 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff Jul 10 00:55:46 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:46 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 1073741824 Jul 10 00:55:46 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:46 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-021d48f0-815d-47c1-aa99-f7a97c7d89b1 tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:55:47 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff" returned: 0 in 0.841s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:47 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff Jul 10 00:55:47 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:47 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 1073741824" returned: 0 in 0.900s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:47 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 Jul 10 00:55:47 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-3904aa15-11a0-4a01-8751-fd157ee83ec4-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Lock "cinder-3904aa15-11a0-4a01-8751-fd157ee83ec4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-d8175444-4b62-4ce4-9959-a091618bf450" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-d8175444-4b62-4ce4-9959-a091618bf450" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-3904aa15-11a0-4a01-8751-fd157ee83ec4" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-3904aa15-11a0-4a01-8751-fd157ee83ec4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot 3904aa15-11a0-4a01-8751-fd157ee83ec4 of volume d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f773ec36-29c3-445b-86f2-6807ade66a8b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:47 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 Jul 10 00:55:47 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:48 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff" returned: 1 in 0.980s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Downloaded image a8e13495-7b96-49c4-a9fa-6458691fa3e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'metadata': {}}])) to volume c3cda45c-0c33-467b-9f00-a6b42aec1eff successfully. {{(pid=87452) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Temporary image a8e13495-7b96-49c4-a9fa-6458691fa3e4 for user 46fc228431f847b2a4f12e5afb5f2f60 is deleted. {{(pid=87452) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.volume_utils [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Marking volume c3cda45c-0c33-467b-9f00-a6b42aec1eff as bootable. {{(pid=87452) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Copying metadata from image a8e13495-7b96-49c4-a9fa-6458691fa3e4 to c3cda45c-0c33-467b-9f00-a6b42aec1eff. {{(pid=87452) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Creating volume glance metadata for volume c3cda45c-0c33-467b-9f00-a6b42aec1eff backed by image a8e13495-7b96-49c4-a9fa-6458691fa3e4 with: {'image_id': 'a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9be5b8a5b673600b0fc34e517bc1acd5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87452) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:55:48 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464" returned: 0 in 0.817s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bed738-5bfe-456b-9533-84d700e8cd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e698e6-24f5-4ce2-bb65-712e1b755464', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5899dffa-1461-42ca-915b-d5e13d58cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Volume volume-39e698e6-24f5-4ce2-bb65-712e1b755464 (39e698e6-24f5-4ce2-bb65-712e1b755464): created successfully Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5899dffa-1461-42ca-915b-d5e13d58cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (9c5a1b26-a37f-4d52-a96c-27b6bf0ea6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cfa2ff2a-0b8c-47cd-afa5-46b61f657d18 tempest-ProjectReaderTests-1003598966 None] Created volume successfully. Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b66bc03e-b9ae-4e6d-b721-9e5594e54e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff', 'volume_size': 1, 'image_id': 'a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9be5b8a5b673600b0fc34e517bc1acd5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a497378a34d54014b10b99d80ed2451d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7bff3e27bbbdf7621971e58295b6c43d0414896e1d3325e866ebfdf4d59dd2b0ef52e44e1f6933c998121b854ef2685814c8ab5570d2f06f9a937d5607f96338', 'id': 'a8e13495-7b96-49c4-a9fa-6458691fa3e4', 'created_at': datetime.datetime(2026, 7, 9, 22, 55, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 55, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8e13495-7b96-49c4-a9fa-6458691fa3e4/file', 'properties': {}}, 'image_service': }' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b9e138-7f9b-4ef9-a0ca-028ceedac8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:48 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Volume volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff (c3cda45c-0c33-467b-9f00-a6b42aec1eff): created successfully Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b9e138-7f9b-4ef9-a0ca-028ceedac8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Flow 'volume_create_manager' (6811466f-4153-4777-b346-a5ba7e8cab85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-457c098a-e115-4e41-8145-0289c96e9779 tempest-VolumeImageDependencyTests-441088266 None] Created volume successfully. Jul 10 00:55:48 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4" returned: 0 in 0.910s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8175444-4b62-4ce4-9959-a091618bf450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[120fd46a-32e8-4926-a6b9-968084ff2235]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Creating offline snapshot 79ad0d75-6f26-4d81-9821-2c05267c54d5 of volume 39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:55:48 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 Jul 10 00:55:48 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e5db6b-0a5a-44bc-a5f4-7674af3b5cda]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:48 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 Jul 10 00:55:48 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Acquiring lock "cinder-c3cda45c-0c33-467b-9f00-a6b42aec1eff-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Lock "cinder-c3cda45c-0c33-467b-9f00-a6b42aec1eff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Acquiring lock "cinder-quobyte-c3cda45c-0c33-467b-9f00-a6b42aec1eff" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Lock "cinder-quobyte-c3cda45c-0c33-467b-9f00-a6b42aec1eff" acquired by "delete_volume" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24fcaf8-70e3-4cd4-b8d9-081d44e40513]: (4, 'raw') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:49 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff Jul 10 00:55:49 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:49 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450" returned: 0 in 0.773s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:49 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 Jul 10 00:55:49 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:49 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464" returned: 0 in 0.866s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:49 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 1G Jul 10 00:55:49 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:50 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff" returned: 0 in 0.778s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:50 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff Jul 10 00:55:50 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:50 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4" returned: 0 in 0.821s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:50 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4 Jul 10 00:55:50 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:50 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 1G" returned: 0 in 0.838s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e698e6-24f5-4ce2-bb65-712e1b755464 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:50 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e698e6-24f5-4ce2-bb65-712e1b755464 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 Jul 10 00:55:50 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:50 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff" returned: 1 in 0.789s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff' failed. Not Retrying. {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:50 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff Jul 10 00:55:50 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:50 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450.3904aa15-11a0-4a01-8751-fd157ee83ec4" returned: 0 in 0.672s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-3904aa15-11a0-4a01-8751-fd157ee83ec4" released by "_delete_snapshot" :: held 3.299s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-d8175444-4b62-4ce4-9959-a091618bf450" released by "delete_snapshot" :: held 3.329s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Created reservations ['d84c341e-d54e-4952-88f8-a4dc60e2e25e', 'bf1a1f22-db0b-4b07-af49-d6b603ebd1af', 'db136230-110a-480a-9644-f70812e2b227', '0fb44ead-83df-4728-8077-25cfc91e6d7c'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:51 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5099e4c2-36ec-4ffb-bab4-229a97d71637 tempest-ProjectMemberTests-411910201 None] Lock "cinder-3904aa15-11a0-4a01-8751-fd157ee83ec4-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:51 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39e698e6-24f5-4ce2-bb65-712e1b755464 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5" returned: 0 in 0.793s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:51 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 is being set with open permissions: ugo+rw Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:51 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 Jul 10 00:55:51 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:51 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c3cda45c-0c33-467b-9f00-a6b42aec1eff" returned: 0 in 0.647s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Lock "cinder-quobyte-c3cda45c-0c33-467b-9f00-a6b42aec1eff" released by "delete_volume" :: held 2.289s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Created reservations ['feeb8229-84f0-4678-92d8-1943d7b19e19', 'fda7e0ed-53af-46cc-96fb-19cc703188a7', '4ae25c18-e577-499b-b259-78ddec09a8df', '6304c615-17b1-456d-b475-f1ea6414ffdf'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:51 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:51 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-d8175444-4b62-4ce4-9959-a091618bf450-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Lock "cinder-d8175444-4b62-4ce4-9959-a091618bf450-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:52 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5" returned: 0 in 0.664s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:52 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.info Jul 10 00:55:52 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-d8175444-4b62-4ce4-9959-a091618bf450" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-d8175444-4b62-4ce4-9959-a091618bf450" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528837d-3046-4a22-a708-38aec9625ff4]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:52 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 Jul 10 00:55:52 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:52 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.688s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:52 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Deleted volume successfully. Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-cad86863-60d5-4a2f-b759-cca06edb6fb8 tempest-VolumeImageDependencyTests-441088266 None] Lock "cinder-c3cda45c-0c33-467b-9f00-a6b42aec1eff-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:52 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.info" returned: 0 in 0.708s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:52 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.info is being set with open permissions: ugo+rw Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:52 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.info Jul 10 00:55:52 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:52 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450" returned: 0 in 0.819s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:52 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450 Jul 10 00:55:52 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:53 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.info" returned: 0 in 0.678s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.640s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:53 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-79804369-0487-477f-896c-089d9d0ab392 tempest-ProjectReaderTests-1003598966 None] Create snapshot completed successfully Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:53 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:53 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:53 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-d8175444-4b62-4ce4-9959-a091618bf450" returned: 0 in 0.716s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-d8175444-4b62-4ce4-9959-a091618bf450" released by "delete_volume" :: held 1.603s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Created reservations ['29a88c46-a9cf-43d8-8bb9-b3f216a5fae7', '7220d9d2-d475-439f-9f67-a558d973428a', '5a4c252a-05b8-4be3-ba82-9946943c3dfd', '9612a759-4c12-4415-9731-69fd05b1ca9b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:53 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:55:53 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-79ad0d75-6f26-4d81-9821-2c05267c54d5-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-79ad0d75-6f26-4d81-9821-2c05267c54d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-39e698e6-24f5-4ce2-bb65-712e1b755464" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-39e698e6-24f5-4ce2-bb65-712e1b755464" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-79ad0d75-6f26-4d81-9821-2c05267c54d5" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-79ad0d75-6f26-4d81-9821-2c05267c54d5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Deleting offline snapshot 79ad0d75-6f26-4d81-9821-2c05267c54d5 of volume 39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] snapshot_file for this snap is: volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba93240c-6efc-4803-b1aa-4ec9809e9fe2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:54 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:54 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 Jul 10 00:55:54 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.790s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:55:54 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.798s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:55:54 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-b260dd9f-7f0e-412f-afc3-421e0efe4e9c tempest-ProjectMemberTests-411910201 None] Lock "cinder-d8175444-4b62-4ce4-9959-a091618bf450-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (cb43a27a-aadd-4dd5-b36d-06ea952ff5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a77a0a8-5331-4baa-a0b5-d52bc0fadc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=203,cinder:DELETE=21,cinder:INSERT=63,cinder:SELECT=156 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a77a0a8-5331-4baa-a0b5-d52bc0fadc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533303721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9248d09-8356-4ccf-9fd7-628d5ac9997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:55Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79d98af-6f27-4a61-935e-b74209ae4388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79d98af-6f27-4a61-935e-b74209ae4388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4144721-39a8-4d4b-a582-4df2e3c6769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4144721-39a8-4d4b-a582-4df2e3c6769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9248d09-8356-4ccf-9fd7-628d5ac9997f', 'volume_name': 'volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4021eed0-8143-44c2-89b8-d97e9e310c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4021eed0-8143-44c2-89b8-d97e9e310c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17632e2a-64f4-46d2-bee3-c6de270c8a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Volume c9248d09-8356-4ccf-9fd7-628d5ac9997f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f', 'volume_size': 1} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533303721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9248d09-8356-4ccf-9fd7-628d5ac9997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:55:55Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Creating volume c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:55:54 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:55:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:55 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f 1073741824 Jul 10 00:55:55 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:55 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5" returned: 0 in 0.920s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e698e6-24f5-4ce2-bb65-712e1b755464(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:55:55 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80af361-9374-4207-84c8-51c31c09b0e2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:55 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 Jul 10 00:55:55 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:55 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f 1073741824" returned: 0 in 0.960s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:55 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=162,cinder:UPDATE=225,cinder:INSERT=54,cinder:DELETE=16 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:55:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:56 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f Jul 10 00:55:56 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:56 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464" returned: 0 in 0.857s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:56 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 Jul 10 00:55:56 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:56 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f" returned: 0 in 0.653s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17632e2a-64f4-46d2-bee3-c6de270c8a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cb5d69-9bd9-42ba-9487-e1477404c1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:55:56 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Volume volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f (c9248d09-8356-4ccf-9fd7-628d5ac9997f): created successfully Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cb5d69-9bd9-42ba-9487-e1477404c1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (cb43a27a-aadd-4dd5-b36d-06ea952ff5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:55:56 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4a3897f5-3759-4675-af32-cb79b93fcd9e tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:55:56 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5" returned: 0 in 0.753s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:56 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-2dc8ca94-1415-4b72-be98-9138cb8d3d40 tempest-ProjectAdminTests-1368756856 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7494354248047, 'free_capacity_gb': 1775.7494354248047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87452) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 00:55:56 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5 Jul 10 00:55:56 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Creating offline snapshot 9faa6e56-53aa-42c1-a5af-ade0e17d4052 of volume c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f907695d-fedc-4108-b588-9f72be10214c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:57 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f Jul 10 00:55:57 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:57 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464.79ad0d75-6f26-4d81-9821-2c05267c54d5" returned: 0 in 0.696s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-79ad0d75-6f26-4d81-9821-2c05267c54d5" released by "_delete_snapshot" :: held 3.357s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-39e698e6-24f5-4ce2-bb65-712e1b755464" released by "delete_snapshot" :: held 3.400s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Created reservations ['77818633-f97b-4027-95f5-f58858e5e046', '7d1bbc3a-cf69-456e-b546-a9f95983421f', '0d3865ce-2960-48f9-8174-1e8bcfc37748', '0acc1cd0-ea52-445f-9b09-f4c6c72d4a4d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:55:57 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Delete snapshot completed successfully. Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-34129459-c331-4f83-9f47-40aef33442f1 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-79ad0d75-6f26-4d81-9821-2c05267c54d5-delete_snapshot" released by "delete_snapshot" :: held 3.573s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:55:57 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f" returned: 0 in 0.795s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:57 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:57 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 1G Jul 10 00:55:57 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-39e698e6-24f5-4ce2-bb65-712e1b755464-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-39e698e6-24f5-4ce2-bb65-712e1b755464-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-39e698e6-24f5-4ce2-bb65-712e1b755464" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-39e698e6-24f5-4ce2-bb65-712e1b755464" acquired by "delete_volume" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0366fb7-851b-4234-96b5-0257cf4342d9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:58 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 Jul 10 00:55:58 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:58 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 1G" returned: 0 in 0.896s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:58 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:58 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 Jul 10 00:55:58 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:59 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464" returned: 0 in 0.819s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:59 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464 Jul 10 00:55:59 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:55:59 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 10 00:55:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052" returned: 0 in 0.781s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:55:59 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 is being set with open permissions: ugo+rw Jul 10 00:55:59 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:55:59 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 Jul 10 00:55:59 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:00 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-39e698e6-24f5-4ce2-bb65-712e1b755464" returned: 0 in 0.655s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-39e698e6-24f5-4ce2-bb65-712e1b755464" released by "delete_volume" :: held 1.558s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Created reservations ['b29616a7-c94b-4b9d-af98-65c7ae44d232', '78d2fadc-ab89-4f8d-a00a-ed9af0e3a3f6', 'd9a8592d-234b-4294-8036-f6f1bdbbafe5', '280e23b8-f8ae-4ff4-a22b-adcce56e071b'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:00 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:56:00 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:00 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052" returned: 0 in 0.700s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:00 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.info Jul 10 00:56:00 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:00 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.679s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:56:00 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Deleted volume successfully. Jul 10 00:56:00 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0a0a7eb6-515e-478a-a9f5-67dc0d307bbc tempest-ProjectReaderTests-1003598966 None] Lock "cinder-39e698e6-24f5-4ce2-bb65-712e1b755464-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:01 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.info" returned: 0 in 0.760s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:01 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.info is being set with open permissions: ugo+rw Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:01 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.info Jul 10 00:56:01 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (fe7f0487-85ab-4966-8746-5627b295d2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94eb794e-666c-409e-a2e4-b83cc2ac0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94eb794e-666c-409e-a2e4-b83cc2ac0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613124009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c409bb-a8d8-47f8-9a31-752f1759ce35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:01Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e606a6-85b6-4c08-b4aa-86dc07f7592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e606a6-85b6-4c08-b4aa-86dc07f7592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5fd123-e893-428a-8933-cf4a93c4212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5fd123-e893-428a-8933-cf4a93c4212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c409bb-a8d8-47f8-9a31-752f1759ce35', 'volume_name': 'volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a901b5fc-2ead-49b3-9865-20251d76cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a901b5fc-2ead-49b3-9865-20251d76cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb1f3dc-fc2f-4487-97a4-33f0bcd3df12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:01 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Volume c4c409bb-a8d8-47f8-9a31-752f1759ce35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35', 'volume_size': 1} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:01 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.info" returned: 0 in 0.682s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.701s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613124009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c409bb-a8d8-47f8-9a31-752f1759ce35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4350737f5743d7a9f08447d297c3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:01Z,use_quota=True,user_id='4598d440feed4c28ae1fb30e9200d441',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Creating volume c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:56:01 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:56:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:01 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 1073741824 Jul 10 00:56:01 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:01 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-24660ca3-2d66-404a-a011-7099320cecd3 tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-9faa6e56-53aa-42c1-a5af-ade0e17d4052-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Lock "cinder-9faa6e56-53aa-42c1-a5af-ade0e17d4052-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-c9248d09-8356-4ccf-9fd7-628d5ac9997f" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-c9248d09-8356-4ccf-9fd7-628d5ac9997f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-9faa6e56-53aa-42c1-a5af-ade0e17d4052" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-9faa6e56-53aa-42c1-a5af-ade0e17d4052" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot 9faa6e56-53aa-42c1-a5af-ade0e17d4052 of volume c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a976e1b-b6fa-469c-84c5-94197b7ddd0c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:02 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 Jul 10 00:56:02 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:02 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 1073741824" returned: 0 in 0.902s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:02 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 Jul 10 00:56:02 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:03 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052" returned: 0 in 0.796s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[df697ac2-0c37-4464-8ae7-21e5793b4597]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:03 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35" returned: 0 in 0.650s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb1f3dc-fc2f-4487-97a4-33f0bcd3df12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d057b183-ebc9-4375-8c8c-c9fa1e3681e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:03 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f Jul 10 00:56:03 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:03 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Volume volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 (c4c409bb-a8d8-47f8-9a31-752f1759ce35): created successfully Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d057b183-ebc9-4375-8c8c-c9fa1e3681e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:03 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Flow 'volume_create_manager' (fe7f0487-85ab-4966-8746-5627b295d2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:03 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ee025cc3-96c7-4181-921d-b88818151a7a tempest-ProjectReaderTests-1003598966 None] Created volume successfully. Jul 10 00:56:04 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f" returned: 0 in 0.788s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:04 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 Jul 10 00:56:04 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Creating offline snapshot 7e32314d-0d97-4c19-b72a-8a7c893296b7 of volume c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[050fb6b9-4943-4bd2-92cd-c3120fb763c1]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:04 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 Jul 10 00:56:04 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:04 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052" returned: 0 in 0.774s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:04 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052 Jul 10 00:56:04 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:05 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35" returned: 0 in 0.909s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:05 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 1G Jul 10 00:56:05 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:05 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f.9faa6e56-53aa-42c1-a5af-ade0e17d4052" returned: 0 in 0.682s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-9faa6e56-53aa-42c1-a5af-ade0e17d4052" released by "_delete_snapshot" :: held 3.166s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-c9248d09-8356-4ccf-9fd7-628d5ac9997f" released by "delete_snapshot" :: held 3.202s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:05 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Created reservations ['2a532e0c-3a48-4d3e-a8bd-17861f39aea0', '1b798a67-8a76-47ba-8766-e0e6ceb05f5f', '8e1e9f03-4d14-4e59-91ec-1646a8403a9a', '1c0e3b58-d04a-4c4f-b2bc-e6d616249b6d'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:56:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-46b8eb17-5839-4886-91d8-27f21f7548ad tempest-ProjectMemberTests-411910201 None] Lock "cinder-9faa6e56-53aa-42c1-a5af-ade0e17d4052-delete_snapshot" released by "delete_snapshot" :: held 3.351s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:06 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 1G" returned: 0 in 0.833s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:06 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 Jul 10 00:56:06 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-c9248d09-8356-4ccf-9fd7-628d5ac9997f-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Lock "cinder-c9248d09-8356-4ccf-9fd7-628d5ac9997f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-c9248d09-8356-4ccf-9fd7-628d5ac9997f" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-c9248d09-8356-4ccf-9fd7-628d5ac9997f" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[6362afc8-3008-4c5f-b01c-af2181c1175b]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:06 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7" returned: 0 in 0.722s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:07 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 is being set with open permissions: ugo+rw Jul 10 00:56:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:07 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 Jul 10 00:56:07 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:07 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f Jul 10 00:56:07 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:07 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f" returned: 0 in 0.845s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:07 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f Jul 10 00:56:07 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:07 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7" returned: 0 in 0.795s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:07 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.info Jul 10 00:56:07 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:08 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c9248d09-8356-4ccf-9fd7-628d5ac9997f" returned: 0 in 0.739s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-c9248d09-8356-4ccf-9fd7-628d5ac9997f" released by "delete_volume" :: held 1.658s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Created reservations ['322876d5-925e-4154-9193-e8a2ea4904b7', '4ecc9513-6cdf-407c-9f54-7e811319ce6a', 'f8b2f5b7-7575-4771-b70f-ecce85a48511', 'f28b3a11-b47b-4112-a79b-71c1492a6189'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:08 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.info" returned: 0 in 0.769s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:08 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.info is being set with open permissions: ugo+rw Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:08 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.info Jul 10 00:56:08 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:08 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:56:08 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:09 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.info" returned: 0 in 0.736s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.894s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-23793e1e-73db-4e5f-ae8e-c593a9cad77f tempest-ProjectReaderTests-1003598966 None] Create snapshot completed successfully Jul 10 00:56:09 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.760s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:56:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afbb4e5-00da-497e-99bb-b0c802f37b5e tempest-ProjectMemberTests-411910201 None] Lock "cinder-c9248d09-8356-4ccf-9fd7-628d5ac9997f-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (ba834bb5-03e4-40df-9379-98c2870c6ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55986052-7e7f-41ac-ad19-c7f080452006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55986052-7e7f-41ac-ad19-c7f080452006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532262044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ae8605-51db-4692-baa5-d4f7a5f7e433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:10Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ef2a6f-cede-418c-8591-9584b3c07ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ef2a6f-cede-418c-8591-9584b3c07ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d9fcc5-5081-454c-ab33-e76f05e1b057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d9fcc5-5081-454c-ab33-e76f05e1b057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ae8605-51db-4692-baa5-d4f7a5f7e433', 'volume_name': 'volume-32ae8605-51db-4692-baa5-d4f7a5f7e433', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd4c5dc-388d-4f83-b8fe-2d0fd47861e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd4c5dc-388d-4f83-b8fe-2d0fd47861e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1083bf-c0dc-484e-bb17-1c623ebe2503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:09 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Volume 32ae8605-51db-4692-baa5-d4f7a5f7e433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ae8605-51db-4692-baa5-d4f7a5f7e433', 'volume_size': 1} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1532262044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ae8605-51db-4692-baa5-d4f7a5f7e433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:10Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Creating volume 32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:56:09 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:09 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 1073741824 Jul 10 00:56:09 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-7e32314d-0d97-4c19-b72a-8a7c893296b7-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-7e32314d-0d97-4c19-b72a-8a7c893296b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-c4c409bb-a8d8-47f8-9a31-752f1759ce35" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-c4c409bb-a8d8-47f8-9a31-752f1759ce35" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-7e32314d-0d97-4c19-b72a-8a7c893296b7" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-7e32314d-0d97-4c19-b72a-8a7c893296b7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Deleting offline snapshot 7e32314d-0d97-4c19-b72a-8a7c893296b7 of volume c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] snapshot_file for this snap is: volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc82d870-84c0-4078-9a22-99a5b9a5078c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:10 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 Jul 10 00:56:10 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:10 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 1073741824" returned: 0 in 0.997s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:10 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7" returned: 0 in 0.831s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:10 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:56:10 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 Jul 10 00:56:10 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:10 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bc9481-0b2b-4358-bf69-ca3b8ef62adf]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:10 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 Jul 10 00:56:10 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:11 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433" returned: 0 in 0.644s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1083bf-c0dc-484e-bb17-1c623ebe2503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ae8605-51db-4692-baa5-d4f7a5f7e433', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761d50ff-9b5d-41fd-b335-253f621eeeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:11 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Volume volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 (32ae8605-51db-4692-baa5-d4f7a5f7e433): created successfully Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761d50ff-9b5d-41fd-b335-253f621eeeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (ba834bb5-03e4-40df-9379-98c2870c6ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:11 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-285a25fc-6d2d-4702-ae66-3f7eb0ee1fc7 tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:56:11 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35" returned: 0 in 0.826s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:11 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 Jul 10 00:56:11 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Creating offline snapshot 548cfdea-afbe-4775-993a-766fb3500ab8 of volume 32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7813c8e8-6ac1-4c1c-87d7-461b5d63356a]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:12 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 Jul 10 00:56:12 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:12 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7" returned: 0 in 0.812s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:12 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7 Jul 10 00:56:12 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:12 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433" returned: 0 in 0.869s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:12 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 1G Jul 10 00:56:12 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:13 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35.7e32314d-0d97-4c19-b72a-8a7c893296b7" returned: 0 in 0.725s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-7e32314d-0d97-4c19-b72a-8a7c893296b7" released by "_delete_snapshot" :: held 3.326s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-c4c409bb-a8d8-47f8-9a31-752f1759ce35" released by "delete_snapshot" :: held 3.360s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:13 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Created reservations ['435f046a-5aa4-4a00-9fe6-f5519b7eaea3', 'e17f4c4a-1191-41f8-89ee-e21f7bdf5177', 'dcab62c5-82c0-4733-845d-860d68d38a65', 'a87388c7-feb4-4d14-9e6d-abaf59992009'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Delete snapshot completed successfully. Jul 10 00:56:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-954e5432-0ce0-4d25-920f-c3ea6932bf46 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-7e32314d-0d97-4c19-b72a-8a7c893296b7-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:13 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 1G" returned: 0 in 0.909s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:13 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 Jul 10 00:56:13 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-c4c409bb-a8d8-47f8-9a31-752f1759ce35-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-c4c409bb-a8d8-47f8-9a31-752f1759ce35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "cinder-quobyte-c4c409bb-a8d8-47f8-9a31-752f1759ce35" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-c4c409bb-a8d8-47f8-9a31-752f1759ce35" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc896376-22ea-4469-a901-71321caaf632]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:14 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 Jul 10 00:56:14 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:14 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8" returned: 0 in 0.719s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:14 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 is being set with open permissions: ugo+rw Jul 10 00:56:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:14 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 Jul 10 00:56:14 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:15 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35" returned: 0 in 0.858s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:15 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8" returned: 0 in 0.686s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:15 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35 Jul 10 00:56:15 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:15 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.info Jul 10 00:56:15 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:15 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-c4c409bb-a8d8-47f8-9a31-752f1759ce35" returned: 0 in 0.692s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-quobyte-c4c409bb-a8d8-47f8-9a31-752f1759ce35" released by "delete_volume" :: held 1.621s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:15 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.info" returned: 0 in 0.714s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:15 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.info is being set with open permissions: ugo+rw Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Created reservations ['f8d6d6ce-afce-4657-9e3f-9c9582c9a456', 'b6fa7057-3093-4035-9571-ff28dc3df812', 'b3c9c953-c216-4d81-871e-7a7fcfd7bc3d', '11306970-71bd-4e4c-b7ef-ec9124bee7f3'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:15 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.info Jul 10 00:56:15 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:15 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:56:15 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:16 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.info" returned: 0 in 0.729s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.726s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f3fc0f5f-9f73-468c-abb1-157de3710f26 tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:56:16 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.770s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:16 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:56:16 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Deleted volume successfully. Jul 10 00:56:16 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-4db40f93-fa12-4a5e-85ec-53b76fe82988 tempest-ProjectReaderTests-1003598966 None] Lock "cinder-c4c409bb-a8d8-47f8-9a31-752f1759ce35-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-548cfdea-afbe-4775-993a-766fb3500ab8-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Lock "cinder-548cfdea-afbe-4775-993a-766fb3500ab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-32ae8605-51db-4692-baa5-d4f7a5f7e433" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-32ae8605-51db-4692-baa5-d4f7a5f7e433" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-548cfdea-afbe-4775-993a-766fb3500ab8" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-548cfdea-afbe-4775-993a-766fb3500ab8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot 548cfdea-afbe-4775-993a-766fb3500ab8 of volume 32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e993929-0c57-4608-9be0-240d044de154]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:17 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 Jul 10 00:56:17 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:18 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8" returned: 0 in 0.945s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:18 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ae8605-51db-4692-baa5-d4f7a5f7e433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:56:18 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79691d9-26b1-4440-bf7b-99982bc64159]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:18 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 Jul 10 00:56:18 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:18 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433" returned: 0 in 0.814s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:19 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 Jul 10 00:56:19 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:19 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8" returned: 0 in 0.734s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:19 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8 Jul 10 00:56:19 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:20 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433.548cfdea-afbe-4775-993a-766fb3500ab8" returned: 0 in 0.628s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-548cfdea-afbe-4775-993a-766fb3500ab8" released by "_delete_snapshot" :: held 3.224s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-32ae8605-51db-4692-baa5-d4f7a5f7e433" released by "delete_snapshot" :: held 3.248s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:20 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Created reservations ['a286e168-e6d5-4ab2-9b44-c71719dbdf4e', '06c87487-3034-4cae-a35b-f5b89ca3f72a', 'd8d0cebd-4ace-490d-a588-b224bb4c981a', 'e4c7d730-1d29-4587-a4c8-2fe571af640a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:56:20 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-dfc40230-2b07-46c0-9492-c583c7bc5dbd tempest-ProjectMemberTests-411910201 None] Lock "cinder-548cfdea-afbe-4775-993a-766fb3500ab8-delete_snapshot" released by "delete_snapshot" :: held 3.370s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-32ae8605-51db-4692-baa5-d4f7a5f7e433-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Lock "cinder-32ae8605-51db-4692-baa5-d4f7a5f7e433-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-32ae8605-51db-4692-baa5-d4f7a5f7e433" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-32ae8605-51db-4692-baa5-d4f7a5f7e433" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:21 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[325429e2-df4a-4841-a0ed-2f6aea1cbd22]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:21 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 Jul 10 00:56:21 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:22 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433" returned: 0 in 0.730s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:22 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433 Jul 10 00:56:22 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:22 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-32ae8605-51db-4692-baa5-d4f7a5f7e433" returned: 0 in 0.634s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-32ae8605-51db-4692-baa5-d4f7a5f7e433" released by "delete_volume" :: held 1.435s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Created reservations ['46c92f26-8d3b-418d-b363-7f2807c9554e', '18b7e104-3987-4f88-a481-285e708323e9', '9926a0c8-7953-4394-b22c-28464d8f2a18', 'e6d19eae-ced5-4e12-8bf0-e77ebed7036f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:22 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:56:22 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:23 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.659s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:23 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:56:23 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:56:23 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0dbef370-061c-44ed-9e94-201bd6afd81b tempest-ProjectMemberTests-411910201 None] Lock "cinder-32ae8605-51db-4692-baa5-d4f7a5f7e433-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (a3f64e62-fb7f-4ab1-844f-f635bdb67aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5dd644-6bce-4813-a948-235414dffd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5dd644-6bce-4813-a948-235414dffd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445758496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bd6104-b95e-44b1-a4cf-2f80303518cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:24Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0c0cbc-2fca-43dc-8386-e18c0ecf3c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0c0cbc-2fca-43dc-8386-e18c0ecf3c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ff5b67-baaa-4820-a4c4-793678454933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ff5b67-baaa-4820-a4c4-793678454933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49bd6104-b95e-44b1-a4cf-2f80303518cb', 'volume_name': 'volume-49bd6104-b95e-44b1-a4cf-2f80303518cb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ba6958-3595-467f-adca-7dc10c87c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ba6958-3595-467f-adca-7dc10c87c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c19a892-449c-4206-9b53-34679f57b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:24 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Volume 49bd6104-b95e-44b1-a4cf-2f80303518cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49bd6104-b95e-44b1-a4cf-2f80303518cb', 'volume_size': 1} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445758496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bd6104-b95e-44b1-a4cf-2f80303518cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:24Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Creating volume 49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:56:24 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:24 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb 1073741824 Jul 10 00:56:24 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:24 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb 1073741824" returned: 0 in 0.861s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:25 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb Jul 10 00:56:25 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:25 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb" returned: 0 in 0.654s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:25 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:56:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c19a892-449c-4206-9b53-34679f57b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bd6104-b95e-44b1-a4cf-2f80303518cb', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de400f0-7c22-414c-bad3-5b26f664bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:25 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Volume volume-49bd6104-b95e-44b1-a4cf-2f80303518cb (49bd6104-b95e-44b1-a4cf-2f80303518cb): created successfully Jul 10 00:56:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de400f0-7c22-414c-bad3-5b26f664bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:25 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (a3f64e62-fb7f-4ab1-844f-f635bdb67aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:25 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-f60e2367-ebec-479c-99c1-3b839c865eb8 tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:56:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Creating offline snapshot 522aef0a-72f6-4327-afc5-02d57fca901f of volume 49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:56:26 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[62245723-d7f8-4c94-afba-ba5491c414b2]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:26 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb Jul 10 00:56:26 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:27 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb" returned: 0 in 0.765s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:27 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f 1G Jul 10 00:56:27 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:27 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f 1G" returned: 0 in 0.838s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:27 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49bd6104-b95e-44b1-a4cf-2f80303518cb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:27 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49bd6104-b95e-44b1-a4cf-2f80303518cb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f Jul 10 00:56:27 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:28 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49bd6104-b95e-44b1-a4cf-2f80303518cb -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f" returned: 0 in 0.787s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:28 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f is being set with open permissions: ugo+rw Jul 10 00:56:28 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:28 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f Jul 10 00:56:28 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:29 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f" returned: 0 in 0.636s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:29 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.info Jul 10 00:56:29 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:29 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.info" returned: 0 in 0.632s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:29 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.info is being set with open permissions: ugo+rw Jul 10 00:56:29 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:30 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.info Jul 10 00:56:30 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:30 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.info" returned: 0 in 0.677s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.429s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:30 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-aefc4b37-77a5-40c2-8ec3-86af60301b8b tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-522aef0a-72f6-4327-afc5-02d57fca901f-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Lock "cinder-522aef0a-72f6-4327-afc5-02d57fca901f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-49bd6104-b95e-44b1-a4cf-2f80303518cb" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-49bd6104-b95e-44b1-a4cf-2f80303518cb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-522aef0a-72f6-4327-afc5-02d57fca901f" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-522aef0a-72f6-4327-afc5-02d57fca901f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot 522aef0a-72f6-4327-afc5-02d57fca901f of volume 49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f3a302-8671-4ea0-ac87-134ca78a8a22]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:31 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f Jul 10 00:56:31 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:32 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f" returned: 0 in 0.836s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:32 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49bd6104-b95e-44b1-a4cf-2f80303518cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:56:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb32e36-da95-4b52-9a2a-3a3c123477ec]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:32 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb Jul 10 00:56:32 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:33 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb" returned: 0 in 0.890s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:33 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f Jul 10 00:56:33 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:34 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f" returned: 0 in 0.790s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:34 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f Jul 10 00:56:34 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:34 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb.522aef0a-72f6-4327-afc5-02d57fca901f" returned: 0 in 0.793s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-522aef0a-72f6-4327-afc5-02d57fca901f" released by "_delete_snapshot" :: held 3.409s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-49bd6104-b95e-44b1-a4cf-2f80303518cb" released by "delete_snapshot" :: held 3.434s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Created reservations ['8ae0d75e-4535-4eac-a7df-ea4a8fd941f6', '7dbf285f-1705-4d23-9e1f-952567a7c82b', 'd09b237b-3c69-43b4-838e-7b2d03265682', 'e140e75b-65d4-417e-b00b-2009f8391eb5'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:35 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-6afe7e87-10ab-42a8-bb8b-5a36ccf3deba tempest-ProjectMemberTests-411910201 None] Lock "cinder-522aef0a-72f6-4327-afc5-02d57fca901f-delete_snapshot" released by "delete_snapshot" :: held 3.584s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-49bd6104-b95e-44b1-a4cf-2f80303518cb-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Lock "cinder-49bd6104-b95e-44b1-a4cf-2f80303518cb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-49bd6104-b95e-44b1-a4cf-2f80303518cb" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-49bd6104-b95e-44b1-a4cf-2f80303518cb" acquired by "delete_volume" :: waited 0.027s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1da12-a72e-4619-ad79-725dfdd5c970]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:35 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb Jul 10 00:56:35 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:36 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb" returned: 0 in 0.803s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:36 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb Jul 10 00:56:36 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:37 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-49bd6104-b95e-44b1-a4cf-2f80303518cb" returned: 0 in 0.656s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-49bd6104-b95e-44b1-a4cf-2f80303518cb" released by "delete_volume" :: held 1.526s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Created reservations ['2bdcd7d0-db10-449a-96fe-973187870d95', 'e8bb2f79-cc3d-4119-bebb-990753d9f07c', '30224138-68cb-400a-bdf7-21f9d94ed2fe', 'f425d295-0819-4891-9724-6e2128c1d1d4'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:37 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:56:37 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:38 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.676s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:56:38 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-859c0c8d-5f5c-4780-8ea6-d8b747547a6c tempest-ProjectMemberTests-411910201 None] Lock "cinder-49bd6104-b95e-44b1-a4cf-2f80303518cb-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (3d5c4447-4b22-4ca4-a9f3-85f77d6140b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b59dc23-a99e-4b27-9fbd-7725e124e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b59dc23-a99e-4b27-9fbd-7725e124e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014932228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa206220-3c73-4eee-b0d0-a04680a69a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:38Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986bbb0e-1da6-419a-8951-67f546ca742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986bbb0e-1da6-419a-8951-67f546ca742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b4c073-3516-4c2b-8115-0685fb597ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b4c073-3516-4c2b-8115-0685fb597ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa206220-3c73-4eee-b0d0-a04680a69a78', 'volume_name': 'volume-fa206220-3c73-4eee-b0d0-a04680a69a78', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04de0ff-70e2-498c-b75b-f480f9f8886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04de0ff-70e2-498c-b75b-f480f9f8886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720fcac3-776d-47fe-acd3-e9f54c9c3932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:38 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Volume fa206220-3c73-4eee-b0d0-a04680a69a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa206220-3c73-4eee-b0d0-a04680a69a78', 'volume_size': 1} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014932228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa206220-3c73-4eee-b0d0-a04680a69a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:38Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Creating volume fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:56:38 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:56:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:38 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 1073741824 Jul 10 00:56:38 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:39 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 1073741824" returned: 0 in 0.827s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:39 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 Jul 10 00:56:39 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:40 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78" returned: 0 in 0.720s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720fcac3-776d-47fe-acd3-e9f54c9c3932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa206220-3c73-4eee-b0d0-a04680a69a78', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe6fe8-4a56-40ba-98c9-28b0c933360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:40 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Volume volume-fa206220-3c73-4eee-b0d0-a04680a69a78 (fa206220-3c73-4eee-b0d0-a04680a69a78): created successfully Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbe6fe8-4a56-40ba-98c9-28b0c933360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (3d5c4447-4b22-4ca4-a9f3-85f77d6140b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:40 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-7caaf882-ca47-4098-ae50-055444805b64 tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Creating offline snapshot ae50278d-e591-4bc7-bd8c-5f70a713bf6b of volume fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0314e2a7-2db9-4e90-a38f-1a14c3889746]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:40 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 Jul 10 00:56:40 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:41 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78" returned: 0 in 0.761s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:41 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b 1G Jul 10 00:56:41 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:42 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b 1G" returned: 0 in 0.869s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa206220-3c73-4eee-b0d0-a04680a69a78 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:42 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa206220-3c73-4eee-b0d0-a04680a69a78 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b Jul 10 00:56:42 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:43 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa206220-3c73-4eee-b0d0-a04680a69a78 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b" returned: 0 in 0.699s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:43 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b is being set with open permissions: ugo+rw Jul 10 00:56:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:43 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b Jul 10 00:56:43 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:43 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b" returned: 0 in 0.663s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:43 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.info Jul 10 00:56:43 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:44 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.info" returned: 0 in 0.637s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:44 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.info is being set with open permissions: ugo+rw Jul 10 00:56:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:44 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.info Jul 10 00:56:44 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:45 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.info" returned: 0 in 0.757s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.475s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5ca98c1a-5a48-4b3f-a5af-093cbca8984b tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Flow 'volume_create_manager' (0a0c58c8-17bd-49fe-b277-ed4dc5d2f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab4923c-291e-4287-9568-3095e8887f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab4923c-291e-4287-9568-3095e8887f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-597590917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1187c3-dd09-4bb7-96a8-518233a1e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64be6e3462ae46b2a55e712e9ff008e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:46Z,use_quota=True,user_id='6c769d81272c4df694de8dd2502738f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3114659e-0d22-4b79-ba32-744ff44952d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3114659e-0d22-4b79-ba32-744ff44952d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab139c1c-85ce-4435-b94b-44bb81c40c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab139c1c-85ce-4435-b94b-44bb81c40c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1187c3-dd09-4bb7-96a8-518233a1e74b', 'volume_name': 'volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629a1abe-d6ac-457e-91e3-b25e21f73527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629a1abe-d6ac-457e-91e3-b25e21f73527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413b3821-a217-410e-8984-9caa301bbade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Volume 0d1187c3-dd09-4bb7-96a8-518233a1e74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b', 'volume_size': 1} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-597590917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1187c3-dd09-4bb7-96a8-518233a1e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64be6e3462ae46b2a55e712e9ff008e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:46Z,use_quota=True,user_id='6c769d81272c4df694de8dd2502738f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Creating volume 0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:56:45 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:56:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-ae50278d-e591-4bc7-bd8c-5f70a713bf6b-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:46 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b 1073741824 Jul 10 00:56:46 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Lock "cinder-ae50278d-e591-4bc7-bd8c-5f70a713bf6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-fa206220-3c73-4eee-b0d0-a04680a69a78" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-fa206220-3c73-4eee-b0d0-a04680a69a78" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-ae50278d-e591-4bc7-bd8c-5f70a713bf6b" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-ae50278d-e591-4bc7-bd8c-5f70a713bf6b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot ae50278d-e591-4bc7-bd8c-5f70a713bf6b of volume fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[c899cfba-b526-4fea-8210-6b6d3eb7decd]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:46 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b Jul 10 00:56:46 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:46 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b 1073741824" returned: 0 in 0.859s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:46 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b" returned: 0 in 0.785s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa206220-3c73-4eee-b0d0-a04680a69a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68aa107-e226-42ec-9325-9324f53c6444]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:46 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b Jul 10 00:56:46 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:47 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 Jul 10 00:56:47 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:47 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b" returned: 0 in 0.625s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413b3821-a217-410e-8984-9caa301bbade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07682e19-4682-4099-b6a1-e4d548c8e9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:47 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Volume volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b (0d1187c3-dd09-4bb7-96a8-518233a1e74b): created successfully Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07682e19-4682-4099-b6a1-e4d548c8e9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Flow 'volume_create_manager' (0a0c58c8-17bd-49fe-b277-ed4dc5d2f40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:47 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-21d16a73-9a08-428f-bbd3-a1b61ec9c386 tempest-SnapshotDependencyTests-1163799104 None] Created volume successfully. Jul 10 00:56:47 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78" returned: 0 in 0.749s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:47 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b Jul 10 00:56:47 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:48 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Creating offline snapshot cd92c7fa-0ac5-4056-8fcb-0461f1d8840a of volume 0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:56:48 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb764b3f-2400-4eee-b21c-46c4604db01c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:48 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b Jul 10 00:56:48 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:48 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b" returned: 0 in 0.744s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:48 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b Jul 10 00:56:48 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:49 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b" returned: 0 in 0.753s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:49 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a 1G Jul 10 00:56:49 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:49 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78.ae50278d-e591-4bc7-bd8c-5f70a713bf6b" returned: 0 in 0.639s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-ae50278d-e591-4bc7-bd8c-5f70a713bf6b" released by "_delete_snapshot" :: held 3.009s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-fa206220-3c73-4eee-b0d0-a04680a69a78" released by "delete_snapshot" :: held 3.029s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Created reservations ['5dfbaa57-0ef4-4bb2-8139-a1712fafeecf', '45152bc9-0d45-4d44-b70c-216cbfed1c4b', 'c2e25ee4-6117-4b7e-93ac-e63433387978', '9bb0bf74-e019-4efc-8ff8-d6b374fe87b1'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:49 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-730c178f-2156-4686-9881-ac4739886f21 tempest-ProjectMemberTests-411910201 None] Lock "cinder-ae50278d-e591-4bc7-bd8c-5f70a713bf6b-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:49 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a 1G" returned: 0 in 0.752s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:49 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:49 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a Jul 10 00:56:49 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-fa206220-3c73-4eee-b0d0-a04680a69a78-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Lock "cinder-fa206220-3c73-4eee-b0d0-a04680a69a78-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-fa206220-3c73-4eee-b0d0-a04680a69a78" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-fa206220-3c73-4eee-b0d0-a04680a69a78" acquired by "delete_volume" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[795adea4-9b5c-453d-aadf-a2520f61ff44]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:50 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" returned: 0 in 0.671s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:50 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a is being set with open permissions: ugo+rw Jul 10 00:56:50 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:50 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a Jul 10 00:56:50 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:50 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 Jul 10 00:56:50 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:51 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" returned: 0 in 0.641s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:51 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:51 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.info Jul 10 00:56:51 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78" returned: 0 in 0.766s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:51 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78 Jul 10 00:56:51 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:51 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.info" returned: 0 in 0.637s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:51 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.info is being set with open permissions: ugo+rw Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:51 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-fa206220-3c73-4eee-b0d0-a04680a69a78" returned: 0 in 0.622s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:51 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.info Jul 10 00:56:51 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-fa206220-3c73-4eee-b0d0-a04680a69a78" released by "delete_volume" :: held 1.451s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Created reservations ['2d4496ae-9588-4d7d-a99f-c12fc9bd604f', 'f984269c-5fe2-46b7-9116-e2beec0d2f12', 'a5e2667b-0099-4507-b6d4-01a6f30252e8', '255b17bd-7e5c-4c1b-b27d-82de4c839e6a'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:51 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:51 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:56:51 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:52 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.info" returned: 0 in 0.620s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.163s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:52 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5d8d50fd-585f-46df-b6c9-b9d33d545650 tempest-SnapshotDependencyTests-1163799104 None] Create snapshot completed successfully Jul 10 00:56:52 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.636s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:56:52 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-059573e8-2384-48c6-ac08-6b033865d338 tempest-ProjectMemberTests-411910201 None] Lock "cinder-fa206220-3c73-4eee-b0d0-a04680a69a78-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (979d2a68-36b4-42a6-b717-62842605f11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103fa899-a029-4f40-ac21-311fc1196fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103fa899-a029-4f40-ac21-311fc1196fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996194299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f59dbe0-0189-484a-9268-bab21c60eeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:53Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc9f29b-87ed-4dba-a357-8c75db07b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc9f29b-87ed-4dba-a357-8c75db07b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09690ad1-fd93-49fd-8883-2e3554d1f1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09690ad1-fd93-49fd-8883-2e3554d1f1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f59dbe0-0189-484a-9268-bab21c60eeb2', 'volume_name': 'volume-2f59dbe0-0189-484a-9268-bab21c60eeb2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa03bd5-7edb-408c-9dba-86ce2b904652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa03bd5-7edb-408c-9dba-86ce2b904652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de675e72-c2f9-4b6c-8960-7897b0184750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:52 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Volume 2f59dbe0-0189-484a-9268-bab21c60eeb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f59dbe0-0189-484a-9268-bab21c60eeb2', 'volume_size': 1} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996194299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f59dbe0-0189-484a-9268-bab21c60eeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:53Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Creating volume 2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:56:52 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:56:52 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:53 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 1073741824 Jul 10 00:56:53 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:53 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:56:53 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:53 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 1073741824" returned: 0 in 0.836s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:53 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 Jul 10 00:56:53 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Flow 'volume_create_manager' (24e5fafa-98aa-4ecb-b95f-f08bdd7b83fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058be4e8-155b-4b43-a1f6-437e879a7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058be4e8-155b-4b43-a1f6-437e879a7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b77f9f-ab64-4b2c-aa0a-864289d1571f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64be6e3462ae46b2a55e712e9ff008e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd92c7fa-0ac5-4056-8fcb-0461f1d8840a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:56:54Z,use_quota=True,user_id='6c769d81272c4df694de8dd2502738f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1803f020-0b30-47da-aff7-aa3cce1da088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1803f020-0b30-47da-aff7-aa3cce1da088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28825b69-83ee-4079-8771-f690381a223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28825b69-83ee-4079-8771-f690381a223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87b77f9f-ab64-4b2c-aa0a-864289d1571f', 'volume_name': 'volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f', 'volume_size': 1, 'snapshot_id': 'cd92c7fa-0ac5-4056-8fcb-0461f1d8840a'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f38e3c-276a-4468-94a6-51037da76782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f38e3c-276a-4468-94a6-51037da76782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc035d61-c6a9-4d31-a6fb-bb3ab35a261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Volume 87b77f9f-ab64-4b2c-aa0a-864289d1571f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f', 'volume_size': 1, 'snapshot_id': 'cd92c7fa-0ac5-4056-8fcb-0461f1d8840a'} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:54 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.693s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:56:54 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2" returned: 0 in 0.669s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.392s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-quobyte-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a-87b77f9f-ab64-4b2c-aa0a-864289d1571f" by "_create_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de675e72-c2f9-4b6c-8960-7897b0184750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f59dbe0-0189-484a-9268-bab21c60eeb2', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df82859-6b41-441b-b85d-eeb29ae554cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a-87b77f9f-ab64-4b2c-aa0a-864289d1571f" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Creating volume 87b77f9f-ab64-4b2c-aa0a-864289d1571f from snapshot cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-quobyte-87b77f9f-ab64-4b2c-aa0a-864289d1571f" by "_copy_volume_from_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:56:54 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Volume volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 (2f59dbe0-0189-484a-9268-bab21c60eeb2): created successfully Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df82859-6b41-441b-b85d-eeb29ae554cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (979d2a68-36b4-42a6-b717-62842605f11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-87b77f9f-ab64-4b2c-aa0a-864289d1571f" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] snapshot: cd92c7fa-0ac5-4056-8fcb-0461f1d8840a, volume: 87b77f9f-ab64-4b2c-aa0a-864289d1571f, {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:56:54 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-bb432a88-1a0e-4735-bbef-39df2829bf04 tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b019b-1b71-4426-9caf-94553e7f6955]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:54 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a Jul 10 00:56:54 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=126,cinder:SELECT=88,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:56:55 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" returned: 0 in 0.756s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Creating direct copy from snapshot {{(pid=87452) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[40887ca7-6b44-458a-83cd-194d52bea774]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:56:55 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:55 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b Jul 10 00:56:55 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:56:56 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 10 00:56:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b" returned: 0 in 0.731s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:56:56 devstack cinder-volume[87452]: DEBUG cinder.utils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Path /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f not found in is_blk_device check {{(pid=87452) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:56:56 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:56:56 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f Jul 10 00:56:56 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:00 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f" returned: 0 in 4.260s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:00 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6bc529-8a93-4f84-80ec-f7b74d257883]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:00 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:00 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b Jul 10 00:57:00 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:01 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b" returned: 0 in 0.931s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:01 devstack cinder-volume[87452]: DEBUG cinder.image.image_utils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Image conversion details: src /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f {{(pid=87452) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:57:01 devstack cinder-volume[87452]: INFO cinder.image.image_utils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Converted 1024.00 MB image at 240.31 MB/s Jul 10 00:57:01 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f is being set with open permissions: ugo+rw Jul 10 00:57:01 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:01 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f Jul 10 00:57:01 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:02 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f" returned: 0 in 0.609s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-87b77f9f-ab64-4b2c-aa0a-864289d1571f" released by "_copy_volume_from_snapshot" :: held 7.395s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a-87b77f9f-ab64-4b2c-aa0a-864289d1571f" released by "_create_volume_from_snapshot" :: held 7.438s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.467s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.812s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=97,cinder:DELETE=9,cinder:SELECT=89,cinder:INSERT=30 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Creating offline snapshot 877b3012-65a4-45cc-9672-8150ad599c77 of volume 2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc035d61-c6a9-4d31-a6fb-bb3ab35a261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f', 'volume_size': 1, 'snapshot_id': 'cd92c7fa-0ac5-4056-8fcb-0461f1d8840a'}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c8c1cf-ad9f-403d-aeaf-b35448c4c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b25c52d-75e2-41b5-9afc-493900e2b9f3]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:02 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Volume volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f (87b77f9f-ab64-4b2c-aa0a-864289d1571f): created successfully Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c8c1cf-ad9f-403d-aeaf-b35448c4c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Flow 'volume_create_manager' (24e5fafa-98aa-4ecb-b95f-f08bdd7b83fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:02 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-3038d35b-c4a4-4743-b7f5-c42bfca6d377 tempest-SnapshotDependencyTests-1163799104 None] Created volume successfully. Jul 10 00:57:02 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 Jul 10 00:57:02 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-quobyte-0d1187c3-dd09-4bb7-96a8-518233a1e74b" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-0d1187c3-dd09-4bb7-96a8-518233a1e74b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-quobyte-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Deleting offline snapshot cd92c7fa-0ac5-4056-8fcb-0461f1d8840a of volume 0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] snapshot_file for this snap is: volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce2250-f9e1-4096-9b40-42ee84eca8c5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:02 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2" returned: 0 in 0.787s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:02 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:02 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 1G Jul 10 00:57:02 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:02 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a Jul 10 00:57:02 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:03 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" returned: 0 in 0.747s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:03 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:57:03 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bbe327-6afc-4832-a6cc-397b1f7479b5]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:03 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 1G" returned: 0 in 0.785s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:03 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:03 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 Jul 10 00:57:03 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:03 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b Jul 10 00:57:03 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:04 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:04 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b" returned: 0 in 0.743s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77" returned: 0 in 0.687s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:04 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 is being set with open permissions: ugo+rw Jul 10 00:57:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:04 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a Jul 10 00:57:04 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:04 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 Jul 10 00:57:04 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:04 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77" returned: 0 in 0.615s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:04 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:05 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.info Jul 10 00:57:05 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:05 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" returned: 0 in 0.740s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:05 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a Jul 10 00:57:05 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:05 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.info" returned: 0 in 0.631s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:05 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.info is being set with open permissions: ugo+rw Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:05 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.info Jul 10 00:57:05 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:05 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b.cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" returned: 0 in 0.621s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a" released by "_delete_snapshot" :: held 2.945s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-0d1187c3-dd09-4bb7-96a8-518233a1e74b" released by "delete_snapshot" :: held 2.968s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Created reservations ['d5679dd9-6e59-4316-9562-a77d042ecfbb', 'de2971e3-1fb7-41bb-8695-a65a582b6240', '3fdd7642-8249-487f-abdc-f1e14337ae11', 'af46c319-3a0b-4351-8c80-0ac80ebe8249'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:05 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Delete snapshot completed successfully. Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5ec5e51f-5648-4158-b889-4df6b95ed835 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-cd92c7fa-0ac5-4056-8fcb-0461f1d8840a-delete_snapshot" released by "delete_snapshot" :: held 3.108s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-0d1187c3-dd09-4bb7-96a8-518233a1e74b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:05 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-0d1187c3-dd09-4bb7-96a8-518233a1e74b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-quobyte-0d1187c3-dd09-4bb7-96a8-518233a1e74b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-0d1187c3-dd09-4bb7-96a8-518233a1e74b" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[584ddbaa-87cb-4bf0-9aef-df3db3ddd86f]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:06 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b Jul 10 00:57:06 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:06 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.info" returned: 0 in 0.654s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:06 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-8f30f3a3-0285-41dc-b925-e082353efb50 tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-877b3012-65a4-45cc-9672-8150ad599c77-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Lock "cinder-877b3012-65a4-45cc-9672-8150ad599c77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-2f59dbe0-0189-484a-9268-bab21c60eeb2" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-2f59dbe0-0189-484a-9268-bab21c60eeb2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-877b3012-65a4-45cc-9672-8150ad599c77" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:06 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b" returned: 0 in 0.765s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-877b3012-65a4-45cc-9672-8150ad599c77" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot 877b3012-65a4-45cc-9672-8150ad599c77 of volume 2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:57:06 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b Jul 10 00:57:06 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[73140d85-be17-421c-b82c-90fcc3430716]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:06 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:06 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 Jul 10 00:57:06 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:07 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-0d1187c3-dd09-4bb7-96a8-518233a1e74b" returned: 0 in 0.633s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-0d1187c3-dd09-4bb7-96a8-518233a1e74b" released by "delete_volume" :: held 1.448s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Created reservations ['eaebc7eb-13a2-4758-8203-85aa7a69f7ae', 'dd5a602d-c3fd-490b-a855-a1a3bda575cc', '6cc1347f-6bcb-41cc-9aef-afc8bbebbd2e', '9916c7ef-9bea-4fdf-9c17-3c1fc7041c52'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:07 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:07 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:07 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77" returned: 0 in 0.773s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f59dbe0-0189-484a-9268-bab21c60eeb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c3c42d-7fae-4536-8c6b-98c224e16ad9]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:07 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:07 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 Jul 10 00:57:07 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-87b77f9f-ab64-4b2c-aa0a-864289d1571f-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-87b77f9f-ab64-4b2c-aa0a-864289d1571f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "cinder-quobyte-87b77f9f-ab64-4b2c-aa0a-864289d1571f" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-87b77f9f-ab64-4b2c-aa0a-864289d1571f" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:08 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.692s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:08 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Deleted volume successfully. Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[9999bcdb-cd43-4544-a5f0-6dfa189e5c8e]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a6883901-7e55-43a9-8549-9060d0890aa9 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-0d1187c3-dd09-4bb7-96a8-518233a1e74b-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:08 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f Jul 10 00:57:08 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:08 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2" returned: 0 in 0.776s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:08 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:08 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 Jul 10 00:57:08 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:09 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f" returned: 0 in 0.760s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:09 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f Jul 10 00:57:09 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:09 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77" returned: 0 in 0.702s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:09 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77 Jul 10 00:57:09 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:09 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-87b77f9f-ab64-4b2c-aa0a-864289d1571f" returned: 0 in 0.632s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-quobyte-87b77f9f-ab64-4b2c-aa0a-864289d1571f" released by "delete_volume" :: held 1.447s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Created reservations ['3af239fd-110e-4c9b-89e6-4b60bcb78a48', '3980073a-f9a7-41a9-857d-e93cd791423c', 'a4b7ad43-ea90-48e9-b780-bcaaafc76466', 'cba6b510-9b3e-4e16-b4a0-bb2a761c7d90'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:09 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2.877b3012-65a4-45cc-9672-8150ad599c77" returned: 0 in 0.617s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-877b3012-65a4-45cc-9672-8150ad599c77" released by "_delete_snapshot" :: held 2.983s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-2f59dbe0-0189-484a-9268-bab21c60eeb2" released by "delete_snapshot" :: held 3.016s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:09 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:09 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Created reservations ['8915c858-07f6-4069-a66f-ef423234db4c', '585dabb9-13fc-4c46-98a9-886b9e90b57b', '9d6b82a8-2329-41b1-bcc0-0aad1fc4b8c7', '55a3c466-6101-494f-b2da-dcdbfb63b476'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:09 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:57:09 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-d0323863-a9a9-4cc3-884e-82a4847664bc tempest-ProjectMemberTests-411910201 None] Lock "cinder-877b3012-65a4-45cc-9672-8150ad599c77-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:10 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:10 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.649s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:10 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:10 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Deleted volume successfully. Jul 10 00:57:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-5fcddcba-a7db-4889-9f03-bed670b29475 tempest-SnapshotDependencyTests-1163799104 None] Lock "cinder-87b77f9f-ab64-4b2c-aa0a-864289d1571f-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-2f59dbe0-0189-484a-9268-bab21c60eeb2-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:10 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Lock "cinder-2f59dbe0-0189-484a-9268-bab21c60eeb2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-2f59dbe0-0189-484a-9268-bab21c60eeb2" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:11 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-2f59dbe0-0189-484a-9268-bab21c60eeb2" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:11 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822bb0a-4cf9-443a-b7f5-6440f8f4be24]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:11 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 Jul 10 00:57:11 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:11 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2" returned: 0 in 0.806s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:11 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:11 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2 Jul 10 00:57:11 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:12 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-2f59dbe0-0189-484a-9268-bab21c60eeb2" returned: 0 in 0.663s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-2f59dbe0-0189-484a-9268-bab21c60eeb2" released by "delete_volume" :: held 1.552s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Created reservations ['024ae298-ca7b-4a8e-9040-8e1bfba4ed23', '62f7e70e-1797-49b3-ab83-349c73bcbeb7', '591d7b86-2400-4341-8192-907361e9eed7', 'f6a065e0-051d-481f-b73f-cf678212cca5'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:12 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:12 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:12 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:13 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.756s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:13 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-0f049399-52b7-481b-b925-0ac13fee68dd tempest-ProjectMemberTests-411910201 None] Lock "cinder-2f59dbe0-0189-484a-9268-bab21c60eeb2-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (a54fde8c-fc55-46bb-8068-f988b5653041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf4cd9-8e7a-472b-856f-5281588a75ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf4cd9-8e7a-472b-856f-5281588a75ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159087073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b433dd-d4b9-49b3-ac45-ffa55b24d09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:14Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed69494-b0e7-4222-9dff-c8f2b66e7f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed69494-b0e7-4222-9dff-c8f2b66e7f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee998c4d-8abe-4e38-bb91-8a91239952fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee998c4d-8abe-4e38-bb91-8a91239952fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b433dd-d4b9-49b3-ac45-ffa55b24d09b', 'volume_name': 'volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d543b4c-c3d1-4c5a-b99f-9523393dcc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d543b4c-c3d1-4c5a-b99f-9523393dcc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8bea29-1d92-4f5d-a436-5443e4164134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:13 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Volume 53b433dd-d4b9-49b3-ac45-ffa55b24d09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b', 'volume_size': 1} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159087073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b433dd-d4b9-49b3-ac45-ffa55b24d09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff06189483459f86164bbcd821506a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:14Z,use_quota=True,user_id='961e0c0e99784199bce1b5025f0985e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Creating volume 53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:57:13 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:57:13 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:13 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b 1073741824 Jul 10 00:57:13 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:14 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b 1073741824" returned: 0 in 0.843s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:14 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:14 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b Jul 10 00:57:14 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:15 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" returned: 0 in 0.661s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8bea29-1d92-4f5d-a436-5443e4164134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2647a8b-3213-4514-90a7-219ce3436874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:15 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Volume volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b (53b433dd-d4b9-49b3-ac45-ffa55b24d09b): created successfully Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2647a8b-3213-4514-90a7-219ce3436874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Flow 'volume_create_manager' (a54fde8c-fc55-46bb-8068-f988b5653041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:15 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-e004e8da-c5bb-4e8d-bb01-9a1debdd9b1f tempest-ProjectMemberTests-411910201 None] Created volume successfully. Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Creating offline snapshot 6fe0af3c-063d-4350-9d7a-b7ad2c969fde of volume 53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[413af7ac-d554-4cb2-992e-b956eb1b2320]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:15 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:16 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b Jul 10 00:57:16 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:16 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" returned: 0 in 0.819s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:16 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde 1G {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:16 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde 1G Jul 10 00:57:16 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:17 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde 1G" returned: 0 in 0.850s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:17 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:17 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde Jul 10 00:57:17 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:18 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b -F qcow2 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde" returned: 0 in 0.728s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:18 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde is being set with open permissions: ugo+rw Jul 10 00:57:18 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:18 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde Jul 10 00:57:18 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:19 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde" returned: 0 in 0.672s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:19 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.info Jul 10 00:57:19 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:19 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.info" returned: 0 in 0.743s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:19 devstack cinder-volume[87452]: WARNING cinder.volume.drivers.remotefs [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.info is being set with open permissions: ugo+rw Jul 10 00:57:19 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.info {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:19 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.info Jul 10 00:57:19 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:20 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.info" returned: 0 in 0.613s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:20 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:20 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-ea3bf57b-6938-4288-bbc2-40e58c45e511 tempest-ProjectMemberTests-411910201 None] Create snapshot completed successfully Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-6fe0af3c-063d-4350-9d7a-b7ad2c969fde-delete_snapshot" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Lock "cinder-6fe0af3c-063d-4350-9d7a-b7ad2c969fde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" by "delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-6fe0af3c-063d-4350-9d7a-b7ad2c969fde" by "_delete_snapshot" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-6fe0af3c-063d-4350-9d7a-b7ad2c969fde" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Deleting offline snapshot 6fe0af3c-063d-4350-9d7a-b7ad2c969fde of volume 53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] snapshot_file for this snap is: volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde {{(pid=87452) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a94f1-9c4c-4ea8-9fdc-3d48ef049d40]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:21 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:21 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde Jul 10 00:57:21 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:22 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde" returned: 0 in 0.719s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:22 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87452) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:57:22 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ba8a7e-5377-4d40-b063-881adde6ebef]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:22 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b Jul 10 00:57:22 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:22 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" returned: 0 in 0.723s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:22 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:22 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde Jul 10 00:57:22 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:23 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde" returned: 0 in 0.683s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:23 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:23 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde Jul 10 00:57:23 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:24 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b.6fe0af3c-063d-4350-9d7a-b7ad2c969fde" returned: 0 in 0.595s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-6fe0af3c-063d-4350-9d7a-b7ad2c969fde" released by "_delete_snapshot" :: held 2.808s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" released by "delete_snapshot" :: held 2.829s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Created reservations ['ecb7c5b5-60f9-44dd-91a1-cdf37374cfc1', '27c43c7b-ce8d-4627-a809-2674c468a1b2', 'cce27183-8750-43d8-bf0d-833ab5b2ade9', '9e8da5ba-b924-46ea-a432-2c062b533471'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:24 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Delete snapshot completed successfully. Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-48294e2f-da50-43df-9cf4-03be449bbb53 tempest-ProjectMemberTests-411910201 None] Lock "cinder-6fe0af3c-063d-4350-9d7a-b7ad2c969fde-delete_snapshot" released by "delete_snapshot" :: held 2.953s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-53b433dd-d4b9-49b3-ac45-ffa55b24d09b-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Lock "cinder-53b433dd-d4b9-49b3-ac45-ffa55b24d09b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Acquiring lock "cinder-quobyte-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" acquired by "delete_volume" :: waited 0.023s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e3941-bdf4-48fd-a316-e853bf435c2c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:24 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:24 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b Jul 10 00:57:24 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:25 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" returned: 0 in 0.746s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:25 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b Jul 10 00:57:25 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:25 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:25 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" returned: 0 in 0.619s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:25 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Lock "cinder-quobyte-53b433dd-d4b9-49b3-ac45-ffa55b24d09b" released by "delete_volume" :: held 1.420s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:25 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Created reservations ['d1e0f893-f916-4c43-b243-d170b882228e', 'b14e5e02-5fd5-4e1c-a736-cb7b424dbf65', '65423071-cc52-4cb3-9f1f-3adcf313da8c', 'db80b328-50d8-4d9d-abce-669ec4b21845'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:26 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:26 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:26 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.623s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:26 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Deleted volume successfully. Jul 10 00:57:26 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-de54aa15-510f-498f-b504-791bbc4de75e tempest-ProjectMemberTests-411910201 None] Lock "cinder-53b433dd-d4b9-49b3-ac45-ffa55b24d09b-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:29 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:57:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (ec658ea9-047c-4414-922b-d59f6abdd30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:29 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d967d9c4-e81c-40c3-8e09-427ebf3cab79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d967d9c4-e81c-40c3-8e09-427ebf3cab79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580485090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c9285e-c37c-45cc-be82-7bccc2967590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:30Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2861f6bf-5d2d-4de3-8b66-6200bcd79051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2861f6bf-5d2d-4de3-8b66-6200bcd79051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8a85ca-401c-4b3e-93c6-9bc12efe9d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8a85ca-401c-4b3e-93c6-9bc12efe9d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c9285e-c37c-45cc-be82-7bccc2967590', 'volume_name': 'volume-54c9285e-c37c-45cc-be82-7bccc2967590', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60569542-3f49-479c-b3e9-50c21dc3c38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60569542-3f49-479c-b3e9-50c21dc3c38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ac6957-964e-4cba-89f1-f87438cbc36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:30 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Volume 54c9285e-c37c-45cc-be82-7bccc2967590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c9285e-c37c-45cc-be82-7bccc2967590', 'volume_size': 1} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580485090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c9285e-c37c-45cc-be82-7bccc2967590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:30Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Creating volume 54c9285e-c37c-45cc-be82-7bccc2967590 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:57:30 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:30 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 1073741824 Jul 10 00:57:30 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:30 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 1073741824" returned: 0 in 0.784s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:30 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:30 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 Jul 10 00:57:30 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:31 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590" returned: 0 in 0.618s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:31 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:57:31 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ac6957-964e-4cba-89f1-f87438cbc36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c9285e-c37c-45cc-be82-7bccc2967590', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bca6d6-f12e-4ef8-8775-5dd143253571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:31 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Volume volume-54c9285e-c37c-45cc-be82-7bccc2967590 (54c9285e-c37c-45cc-be82-7bccc2967590): created successfully Jul 10 00:57:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bca6d6-f12e-4ef8-8775-5dd143253571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:31 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (ec658ea9-047c-4414-922b-d59f6abdd30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:31 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-26c27438-9592-40bb-bbb3-b3ed8b11c475 tempest-ProjectReaderTests-1595329592 None] Created volume successfully. Jul 10 00:57:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-54c9285e-c37c-45cc-be82-7bccc2967590-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Lock "cinder-54c9285e-c37c-45cc-be82-7bccc2967590-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-quobyte-54c9285e-c37c-45cc-be82-7bccc2967590" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:32 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-54c9285e-c37c-45cc-be82-7bccc2967590" acquired by "delete_volume" :: waited 0.015s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:32 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51264f9-8cf0-44ce-82dd-1d9c87669c01]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:32 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:32 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 Jul 10 00:57:32 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:33 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590" returned: 0 in 0.741s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:33 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590 Jul 10 00:57:33 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:33 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-54c9285e-c37c-45cc-be82-7bccc2967590" returned: 0 in 0.619s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-54c9285e-c37c-45cc-be82-7bccc2967590" released by "delete_volume" :: held 1.395s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Created reservations ['8410eacd-7cc4-485a-b0cf-083b8e5f3b11', '6e5727cf-515e-4919-8807-fb1c7869e730', '787961d2-a436-41ec-8f86-e5c517a682b2', '3f0c09e8-2d98-494c-b50c-90a49c7082b3'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:33 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:33 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:33 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:34 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.681s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:34 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Deleted volume successfully. Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-9d94bf80-6316-49a0-ab96-813c0811bbec tempest-ProjectReaderTests-1595329592 None] Lock "cinder-54c9285e-c37c-45cc-be82-7bccc2967590-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (e831f50d-41da-4acb-8161-fa0eddc45ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f0c3d7-03fb-46eb-9dc9-0eb625da4673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f0c3d7-03fb-46eb-9dc9-0eb625da4673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130544948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3870a06c-9fae-41a7-a82a-5f9250d4b5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:35Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054c8a59-aa74-4e5e-9f4c-2f4ef1a4eace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054c8a59-aa74-4e5e-9f4c-2f4ef1a4eace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af6fd20-cca5-4b0b-80e7-2d7584814f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af6fd20-cca5-4b0b-80e7-2d7584814f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3870a06c-9fae-41a7-a82a-5f9250d4b5f6', 'volume_name': 'volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5962ce25-7d58-4d19-a9fb-7c1ac88fc250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5962ce25-7d58-4d19-a9fb-7c1ac88fc250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013c3f45-4f91-430c-a438-16baa3a6b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:34 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Volume 3870a06c-9fae-41a7-a82a-5f9250d4b5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6', 'volume_size': 1} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130544948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3870a06c-9fae-41a7-a82a-5f9250d4b5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:35Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Creating volume 3870a06c-9fae-41a7-a82a-5f9250d4b5f6 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:57:34 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:57:34 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:34 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 1073741824 Jul 10 00:57:34 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:35 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 1073741824" returned: 0 in 0.784s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:35 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:35 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 Jul 10 00:57:35 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:36 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6" returned: 0 in 0.617s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013c3f45-4f91-430c-a438-16baa3a6b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcab2a7-8a4f-4fdf-884d-74619cc05a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:36 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Volume volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 (3870a06c-9fae-41a7-a82a-5f9250d4b5f6): created successfully Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcab2a7-8a4f-4fdf-884d-74619cc05a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (e831f50d-41da-4acb-8161-fa0eddc45ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:36 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-bc15602b-1bfc-4a99-9497-d6f29b5ef21f tempest-ProjectReaderTests-1595329592 None] Created volume successfully. Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-3870a06c-9fae-41a7-a82a-5f9250d4b5f6-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-3870a06c-9fae-41a7-a82a-5f9250d4b5f6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:36 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-quobyte-3870a06c-9fae-41a7-a82a-5f9250d4b5f6" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:37 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-3870a06c-9fae-41a7-a82a-5f9250d4b5f6" acquired by "delete_volume" :: waited 0.016s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:37 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cfda90-2299-4fdb-b849-c250dc021d1c]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:37 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 Jul 10 00:57:37 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:37 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6" returned: 0 in 0.710s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:37 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:37 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6 Jul 10 00:57:37 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:38 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-3870a06c-9fae-41a7-a82a-5f9250d4b5f6" returned: 0 in 0.620s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-3870a06c-9fae-41a7-a82a-5f9250d4b5f6" released by "delete_volume" :: held 1.365s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Created reservations ['f99ea695-8ae6-4b3c-a143-a0fb0548a871', '0230553e-ec4f-4dcf-81fa-0a27f0148fb5', '3038f4ab-8b0c-4c5f-9d27-03d643a48af2', 'a6ed7012-d132-4893-b427-1b0cba53db50'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:38 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:38 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:38 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:39 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.622s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:39 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Deleted volume successfully. Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-59cd2aa8-99d0-4da1-9fb2-36814441f3d3 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-3870a06c-9fae-41a7-a82a-5f9250d4b5f6-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (a7bdf78c-63ac-4309-ba98-62a51dbaa40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6d44a7-35c4-433b-a132-dc1db3b6d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6d44a7-35c4-433b-a132-dc1db3b6d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525655697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f36979-05e1-4ed8-aab0-db7cb3818b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:40Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffb8125-444a-4ce4-a65e-79da550f4bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffb8125-444a-4ce4-a65e-79da550f4bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75727480-bca2-4575-94f1-6c65dd2430e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75727480-bca2-4575-94f1-6c65dd2430e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f36979-05e1-4ed8-aab0-db7cb3818b58', 'volume_name': 'volume-45f36979-05e1-4ed8-aab0-db7cb3818b58', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100e3bb8-62f9-4fcf-afc8-fb601d7c788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100e3bb8-62f9-4fcf-afc8-fb601d7c788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c8c258-cb5a-40d9-8401-828bb455fc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:39 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Volume 45f36979-05e1-4ed8-aab0-db7cb3818b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f36979-05e1-4ed8-aab0-db7cb3818b58', 'volume_size': 1} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525655697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f36979-05e1-4ed8-aab0-db7cb3818b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:40Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Creating volume 45f36979-05e1-4ed8-aab0-db7cb3818b58 {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:57:39 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:57:39 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:39 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 1073741824 Jul 10 00:57:39 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:40 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 1073741824" returned: 0 in 0.777s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:40 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:40 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 Jul 10 00:57:40 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:41 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58" returned: 0 in 0.636s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c8c258-cb5a-40d9-8401-828bb455fc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f36979-05e1-4ed8-aab0-db7cb3818b58', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc67dac-ba96-4999-8da6-c9a42123e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:41 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Volume volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 (45f36979-05e1-4ed8-aab0-db7cb3818b58): created successfully Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc67dac-ba96-4999-8da6-c9a42123e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (a7bdf78c-63ac-4309-ba98-62a51dbaa40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:41 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-beb45e95-b46c-43df-973d-95485a623021 tempest-ProjectReaderTests-1595329592 None] Created volume successfully. Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-45f36979-05e1-4ed8-aab0-db7cb3818b58-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-45f36979-05e1-4ed8-aab0-db7cb3818b58-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-quobyte-45f36979-05e1-4ed8-aab0-db7cb3818b58" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-45f36979-05e1-4ed8-aab0-db7cb3818b58" acquired by "delete_volume" :: waited 0.014s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a62f4ad-70c6-4fde-97ec-86d8f8a487f8]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:41 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:41 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 Jul 10 00:57:41 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:42 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58" returned: 0 in 0.737s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:42 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:42 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58 Jul 10 00:57:42 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:43 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-45f36979-05e1-4ed8-aab0-db7cb3818b58" returned: 0 in 0.620s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-45f36979-05e1-4ed8-aab0-db7cb3818b58" released by "delete_volume" :: held 1.394s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Created reservations ['a44ebefd-0808-4b7f-a268-679c7e05a426', 'deaa9c76-f135-4430-a359-f857d30f95f8', 'f9495e52-8b84-4b6c-b1c7-15c821e915aa', '38204b20-db79-4d04-9da6-0da31a5efd54'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:43 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:43 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:43 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.637s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:43 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Deleted volume successfully. Jul 10 00:57:43 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-35795223-b28f-467c-9655-060432eebfc5 tempest-ProjectReaderTests-1595329592 None] Lock "cinder-45f36979-05e1-4ed8-aab0-db7cb3818b58-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.flows.manager.create_volume [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87452) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (e279495c-0dbb-45c0-9275-80fc54e44579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1966420b-c939-4050-b114-87189fc41889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1966420b-c939-4050-b114-87189fc41889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586783917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20895b79-d4ca-42dd-b861-42c62fcdccab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:44Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8fec2-297e-4449-9003-8be84299b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8fec2-297e-4449-9003-8be84299b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a0e25-2874-4f85-9024-f0701b50cdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a0e25-2874-4f85-9024-f0701b50cdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20895b79-d4ca-42dd-b861-42c62fcdccab', 'volume_name': 'volume-20895b79-d4ca-42dd-b861-42c62fcdccab', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5215509d-b0eb-400d-8b55-63344ac2bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5215509d-b0eb-400d-8b55-63344ac2bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf682a6-9b65-4a8c-aac5-88f128e5e992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:44 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Volume 20895b79-d4ca-42dd-b861-42c62fcdccab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20895b79-d4ca-42dd-b861-42c62fcdccab', 'volume_size': 1} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586783917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20895b79-d4ca-42dd-b861-42c62fcdccab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16347ec8710f4b10a9e6cedddd233d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:57:44Z,use_quota=True,user_id='4bcd98baeeaf4ab2954997a017766b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5578517a-09da-4d9a-8079-0c409dc36a8c),volume_type_id=5578517a-09da-4d9a-8079-0c409dc36a8c)}" {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.remotefs [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Creating volume 20895b79-d4ca-42dd-b861-42c62fcdccab {{(pid=87452) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Selected osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df as target Quobyte volume. {{(pid=87452) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:57:44 devstack cinder-volume[87452]: INFO cinder.volume.drivers.remotefs [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] casted to osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df Jul 10 00:57:44 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab 1073741824 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:44 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab 1073741824 Jul 10 00:57:44 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:45 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab 1073741824" returned: 0 in 0.778s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:45 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab Jul 10 00:57:45 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:45 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab" returned: 0 in 0.627s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'} {{(pid=87452) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf682a6-9b65-4a8c-aac5-88f128e5e992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20895b79-d4ca-42dd-b861-42c62fcdccab', 'volume_size': 1}' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043cd334-1f2c-498b-ad66-2391a7bb59a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:57:45 devstack cinder-volume[87452]: INFO cinder.volume.flows.manager.create_volume [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Volume volume-20895b79-d4ca-42dd-b861-42c62fcdccab (20895b79-d4ca-42dd-b861-42c62fcdccab): created successfully Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043cd334-1f2c-498b-ad66-2391a7bb59a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87452) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:57:45 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Flow 'volume_create_manager' (e279495c-0dbb-45c0-9275-80fc54e44579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87452) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:57:45 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-961053ce-d60c-40cb-9bf3-9ac5c9cdf960 tempest-ProjectReaderTests-1595329592 None] Created volume successfully. Jul 10 00:57:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-20895b79-d4ca-42dd-b861-42c62fcdccab-delete_volume" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Lock "cinder-20895b79-d4ca-42dd-b861-42c62fcdccab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Acquiring lock "cinder-quobyte-20895b79-d4ca-42dd-b861-42c62fcdccab" by "delete_volume" {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:57:46 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-20895b79-d4ca-42dd-b861-42c62fcdccab" acquired by "delete_volume" :: waited 0.013s {{(pid=87452) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:57:46 devstack cinder-volume[87452]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4e71c-9293-4e0c-b7f7-c02d841ef884]: (4, 'qcow2') {{(pid=88295) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:57:46 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:46 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab Jul 10 00:57:46 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:47 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab" returned: 0 in 0.757s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:47 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab Jul 10 00:57:47 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:47 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0/volume-20895b79-d4ca-42dd-b861-42c62fcdccab" returned: 0 in 0.622s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Lock "cinder-quobyte-20895b79-d4ca-42dd-b861-42c62fcdccab" released by "delete_volume" :: held 1.416s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG cinder.quota [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Created reservations ['118f2f40-48ad-417a-9a59-f35c61e1b280', 'dba44be2-2744-4f20-841c-7e0ea6343175', '61b7ac76-1b1d-406c-8d1e-2b794d580fdd', '434219ac-6029-472d-8f66-ecfb59d99c1f'] {{(pid=87452) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:47 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:48 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:48 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:48 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:48 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.616s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:48 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:48 devstack cinder-volume[87452]: INFO cinder.volume.manager [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Deleted volume successfully. Jul 10 00:57:48 devstack cinder-volume[87452]: DEBUG cinder.coordination [None req-a95ac970-b749-4740-8132-f65744a9620c tempest-ProjectReaderTests-1595329592 None] Lock "cinder-20895b79-d4ca-42dd-b861-42c62fcdccab-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87452) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:57:53 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:57:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:57:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:57:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df': None} {{(pid=87452) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:57:53 devstack cinder-volume[87452]: DEBUG cinder.volume.drivers.quobyte [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-520b10c3-b055-4ab8-9b6b-8546a3a233df'] {{(pid=87452) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:57:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.lockutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87452) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:57:53 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:57:53 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0 Jul 10 00:57:53 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:57:54 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Jul 10 00:57:54 devstack cinder-volume[87452]: DEBUG oslo_concurrency.processutils [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1bd80152c1fd66bd6826dd47284cdbf0" returned: 0 in 0.615s {{(pid=87452) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:57:54 devstack cinder-volume[87452]: DEBUG cinder.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Notifying Schedulers of capabilities ... {{(pid=87452) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:57:54 devstack cinder-volume[87452]: DEBUG oslo_service.periodic_task [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] Running periodic task VolumeManager._thread_info {{(pid=87452) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:57:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread count: 28 {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 00:57:54 devstack cinder-volume[87452]: DEBUG cinder.volume.manager [None req-78060762-f785-4848-a05a-87d1bd9947e3 None None] thread info: [<_MainThread(MainThread, started 127149824245888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87452) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:57:57 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:SELECT=67,cinder:UPDATE=90,cinder:INSERT=24,cinder:DELETE=11 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:57:58 devstack cinder-volume[87452]: DEBUG dbcounter [-] [87452] Writing DB stats cinder:UPDATE=110,cinder:DELETE=5,cinder:SELECT=72,cinder:INSERT=27 {{(pid=87452) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}